Fetching Lawyer Details From Different Links Of A Website Using Bs4 In Python

I am an absolute beginner to Web Scraping using Python with very little knowledge in Python programming. I am just trying to extract the information of the lawyers in the Tennesse

Solution 1:

I see the data that you're trying to scrape is too much and using BeautifulSoup will take a lot of time, I tried scraping this website and even after dividing the search into four different program files it took about 12 hours to successfully complete the execution,I also tried your code for only brentwood city and it took about an hour. I see no infinite loop in your code! let it run and have patience.

Also your program has not created any .xml because it has not reached that part of code.

PS: I know this should be a comment but I currently don't have enough reputatuion to do so. Hope this answer helps you and also me to gain reputation to be able to comment next time.