Mastodon Feed: Post

Mastodon Feed

glyph ("Glyph") wrote:

we live in hell but at least PyPI works in hell

    try:         rresp = requests.get(url, timeout=10)     except requests.exceptions.ReadTimeout:         print(f"timed out {url}, trying selenium")         hdata = "{}"         from selenium import webdriver         driver = webdriver.Safari()         driver.get(url)         element = driver.find_element("xpath", "/html")         outerhtml: str = element.get_attribute("outerHTML")  # type:ignore[no-untyped-call]         bdata = outerhtml.encode("utf-8")     else:         hdata = json.dumps(dict(rresp.headers))         bdata = rresp.content