Skip to main content
Internet Archive's 25th Anniversary Logo

View Post [edit]

Poster: ATM17 Date: Jun 23, 2021 11:48am
Forum: general Subject: "Resource file size is over 2GB"

I've been getting this error ("Resource file size is over 2GB") while trying to archive a certain dataset (around 3GB in size per file). The link to one of the files in question is here: http://www.cs.ucf.edu/~aroshan/index_files/Dataset_PitOrlManh/zipped%20images/part1.zip
I wasn't aware that there was a limit in the size of files that could be archived with the Wayback Machine, although it certainly isn't unreasonable for there to be one. Is this a new limit, or have I just missed the resources that describe it?
Sorry if this isn't the appropriate forum; I'm fairly new here.

Thanks,

ATM17 Edit: Grammar This post was modified by ATM17 on 2021-06-23 18:48:02

Reply [edit]

Poster: Jeff Kaplan Date: Jun 23, 2021 10:59pm
Forum: general Subject: Re: 'Resource file size is over 2GB'

yes, you should find a way to reduce the file size.

Reply [edit]

Poster: Imperial Majesty XO Date: Jun 26, 2021 8:49am
Forum: general Subject: Re: 'Resource file size is over 2GB'

I wonder, is there a way to make it so the archive will accept larger file sizes? What would it take?

Reply [edit]

Poster: Casteele Date: Jul 1, 2021 12:21pm
Forum: general Subject: Re: 'Resource file size is over 2GB'

My guess is that it would take a lot of extra bandwidth and storage space. Both of which cost money.

Also, IMO and IME, splitting things in to smaller components also helps avoid needless duplication. I collect a lot of old DOS disks (and use DOSBox and VirtualBox emulation/virtualization to run "ancient systems" and play games of my childhood), especially driver disks, which can often be found in many different collections and archives.