Scraping¶
PyQuery is able to load an html document from a url:
>>> pq(your_url)
[<html>]
By default it uses python’s urllib.
If requests is installed then it will use it. This allow you to use most of requests parameters:
>>> pq(your_url, headers={'user-agent': 'pyquery'})
[<html>]
>>> pq(your_url, {'q': 'foo'}, method='post', verify=True)
[<html>]