Mastodon Feed: Post

Mastodon Feed5 hours, 12 minutes ago

glyph ("Glyph") wrote:

we live in hell but at least PyPI works in hell

$try: rresp = requests.get(url, timeout=10) except requests.exceptions.ReadTimeout: print(f"timed out {url}, trying selenium") hdata = "{}" from selenium import webdriver driver = webdriver.Safari() driver.get(url) element = driver.find_element("xpath", "/html") outerhtml: str = element.get_attribute("outerHTML") # type:ignore[no-untyped-call] bdata = outerhtml.encode("utf-8") else: hdata = json.dumps(dict(rresp.headers)) bdata = rresp.content$