beautifulsoup Archives

Converting html to text with Python

January 14, 2021 Aba Tayler

Question or problem about Python programming: I am trying to convert an html block to text using Python.

BeautifulSoup getText from between
, not picking up subsequent paragraphs

January 13, 2021 Bell Jacquise

Question or problem about Python programming: Firstly, I am a complete newbie when it comes to Python. However, I have written a piece of code to look at an RSS feed, open the link and extract the text from the article. This is what I have so far:

BeatifulSoup4 get_text still has javascript

January 13, 2021 Andrew Rocky

Question or problem about Python programming: I’m trying to remove all the html/javascript using bs4, however, it doesn’t get rid of javascript. I still see it there with the text. How can I get around this?

How to get rid of BeautifulSoup user warning?

January 13, 2021 Odhran Miss

Question or problem about Python programming: After I installed BeautifulSoup, Whenever I run my Python in cmd, this warning comes out.

BeautifulSoup findAll() given multiple classes?

January 11, 2021 Aba Tayler

Question or problem about Python programming: I would like to scrape a list of items from a website, and preserve the order that they are presented in. These items are organized in a table, but they can be one of two different classes (in random order).

Using Python and BeautifulSoup (saved webpage source codes into a local file)

January 10, 2021 Ollie MC

Question or problem about Python programming: I am using Python 2.7 + BeautifulSoup 4.3.2.

Using BeautifulSoup to search html for string

January 7, 2021 Bell Jacquise

Question or problem about Python programming: I am using BeautifulSoup to look for user entered strings on a specific page. For example, I want to see if the string ‘Python’ is located on the page: http://python.org

Remove a tag using BeautifulSoup but keep its contents

January 6, 2021 Andrew Rocky

Question or problem about Python programming: Currently I have code that does something like this:

How to scrape a website which requires login using python and beautifulsoup?

January 5, 2021 James Cameron

Question or problem about Python programming: If I want to scrape a website that requires login with password first, how can I start scraping it with python using beautifulsoup4 library? Below is what I do for websites that do not require login.

Parsing HTML in python – lxml or BeautifulSoup? Which of these is better for what kinds of purposes?

January 4, 2021 Odhran Miss

Question or problem about Python programming: From what I can make out, the two main HTML parsing libraries in Python are lxml and BeautifulSoup. I’ve chosen BeautifulSoup for a project I’m working on, but I chose it for no particular reason other than finding the syntax a bit easier to learn and understand. But I […]