Mastodon Feed: Post

Boosted by cstanhope@social.coop ("Your friendly 'net denizen"):
jonny@neuromatch.social ("jonny (good kind)") wrote:

Check this out! if you are an organization that publishes datasets on the AWS open dataset registry thing, you can do this for free to make this One Weird Extra "Bit Torrent" file to put in your bucket. its cool and legal, and if you tell people to use it instead of downloading from your bucket directly you have to pay the data cartel less ransom while also diluting their monopoly over your information

so like say hypothetically you are the library of congress and you have this bucket of maps named loc-sanborn-maps, and also hypothetically if that data was in a folder on some computer named ./sanborn-maps/, you could do this

python -m pip install sciop-cli
sciop-cli torrent create -p ./sanborn-maps -o ./sanborn-maps.torrent -w "https://loc-sanborn-maps.s3.amazonaws.com"

and then even if you don't have a bittorrent yourself, if someone clicks on that file sanborn-maps.torrent they will download that file both from your bucket but also share it with anyone else who clicks on that file too so less people have to hit your bucket. so weird!