How to Get Content from URL in Python?

AuthorSumit Dey Sarkar

Pubish Date30 Sep 2023

categoryPython

In this tutorial we will learn how to get content from URL in Python.

 

How to get content from URL in Python

 

How to get content from URL in Python

You can use the 'requests' library in Python to fetch content from a URL.

 

Follow below steps to get content form URL in Python:

 

Step 1- Install the requests library if you haven't already. You can install it using pip:

pip install requests

 

Step 2- Import the requests library in your Python script:

import requests

 

Step 3- Use the get method from the requests library to fetch the content of a URL.

Here's an example:

url = 'https://www.teknowize.com'  # Replace with the URL you want to fetch

try:
    response = requests.get(url)

    # Check if the request was successful (status code 200)
    if response.status_code == 200:
        # The content of the response is stored in the 'text' attribute
        content = response.text
        print(content)
    else:
        print(f"Failed to retrieve content. Status code: {response.status_code}")
except requests.exceptions.RequestException as e:
    print(f"An error occurred: {e}")

 

In the code above:

  • Replace 'https://www.teknowize.com' with the URL you want to fetch.
  • We make a GET request to the URL using 'requests.get(url)'.
  • We check if the response status code is 200, which indicates a successful request.
  • If the request is successful, the content of the response is stored in the 'content' variable and printed to the console.
  • If the request fails for any reason, it will catch exceptions and print an error message.

 

Make sure to handle exceptions and error cases appropriately in your code to ensure robustness. Additionally, you can parse and process the retrieved content further based on your requirements once you have it in the 'content' variable.

Comments 0

Leave a comment