Skip to content
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

66 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python Webscraper

The purpose of this webscraper is to monitor a website for changes, then text a phone using Twilio if any changes exist. The program supports multiple websites and Twilio accounts running at the same time.

How to use

  1. LYNN WAS HERE Create a users.yaml file that contains the website you want to scrape and the Twilio account details. This can be done by running user_init.py from the command line and chosing e. Alternatively, you can create the file yourself. The file must contain the following:

    User0:
    {
    element: "Elemnt to watch (ex. h1)",
    name: "Name of user",
    repeat_num: "How many times to repeat total",
    repeat_rate: "how many times in between checks in seconds",
    twilio_auth: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    twilio_phone: "+xxxxxxxxxxx",
    twilio_sid: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    url: "url to watch",
    user_phone: "+1xxxxxxxxxx",
    }
    Use1:
    {
    element: "Elemnt to watch (ex. h1)",
    name: "Name of user",
    repeat_num: "How many times to repeat total",
    repeat_rate: "how many times in between checks in seconds",
    twilio_auth: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    twilio_phone: "+xxxxxxxxxxx",
    twilio_sid: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    url: "url to watch",
    user_phone: "+1xxxxxxxxxx",
    }
    

    The file can have as many "users" as needed.

  2. Run webscraper.py. It will read from the users.yaml file and text the phone number stored in user_phone when the element changes.

About

Looks for changes on a website and texts the changes over Twilio

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages