Skip to main content
Internet Archive's 25th Anniversary Logo

View Post [edit]

Poster: tracey pooh Date: Jul 11, 2015 8:37pm
Forum: forums Subject: Re: Library View Count Not Updating

we absolutely never tracked search results or "my uploads" views counts.

i'm 99.99% sure we never tracked "my favorites" views counts (and if we did, it was only for a short spell and found it presently untractable with our current system and resources.

i'm the website lead programmer and have been so at archive.org for over 10 years now, so you get a sense of where the comments are coming from 8-) -- no "telephone" or "lost in translation" issues going on from our end.

rolling up groups of items view counts has proved difficult for us (for various reasons) so we've mostly stuck to tracking "standard" collections of items (eg: /details/prelinger or /details/GratefulDead or even /details/texts etc.)
and even then, we've had a fair amount of issues over the years.

best regards,
-tracey

Reply [edit]

Poster: geekcookiespodcast Date: Jul 15, 2015 2:36am
Forum: forums Subject: Re: Library View Count Not Updating

Hi tracey,
good to know you are an expert about the infrastructure!

I'm uploading our podcast audio files to archive and I'm pretti sure the "view" columns was update every 24h until one month or so (I wrote a scraper to have download history for each element).In the search for the element I uploaded :

https://archive.org/search.php?query=uploader%3A%22geekcookiespodcast%40gmail.com%22

the view count is now stuck, but at the single element level is stil updating. It is the same if I ask for json or xml result.

Here the json output:

https://archive.org/advancedsearch.php?q=uploader%3A%22geekcookiespodcast%40gmail.com%22&fl[]=downloads&fl[]=identifier&fl[]=title&sort[]=addeddate+desc&sort[]=&sort[]=&rows=50&page=1&output=json&callback=callback&save=yes

I was excited to get the json output, no more scraping aorund!

Is there something I'm doing wrong? Is a place where I can get the aggregated views count from all the files I upload?

Thanks and thank you for the terrific work behind the scenes!

Reply [edit]

Poster: tracey pooh Date: Jul 15, 2015 7:04am
Forum: forums Subject: Re: Library View Count Not Updating

OK, so I'm confused just by the part you wrote above here:

"the view count is now stuck, but at the single element level is stil updating."

because there is no aggregated view count that we compute or output/produce for an arbitrary search.



Using a JSON indenter and "colordiff" (to make it easy), I'll verify much of my items change tonight by comparing today's output with tomorrow's output of this:

https://archive.org/advancedsearch.php?q=collection%3ApoohBot&fl%5B%5D=downloads&fl%5B%5D=identifier&sort%5B%5D=identifier+asc&sort%5B%5D=&sort%5B%5D=&rows=500&page=1&output=json

Reply [edit]

Poster: tracey pooh Date: Jul 16, 2015 7:35am
Forum: forums Subject: Re: Library View Count Not Updating

OK!

I think I now understand what you are referring to, and there *IS* a new problem I was able to find just now.

So I think what you've been noticing is that individual items in our search engine (ie: not collections, but single items) have had their download counts updated nightly normally, but that stopped semi-recently.

CORRECT! 8-) (that's good and bad news, right?)

We are in process of migrating our search engine. Our current live (soon to be dropped) search engine *just* ran out of avail space in /tmp for what it needs to do each night to update items.

So I've pushed live a workaround and am manually re-running last night's run now (and then every night the normal run should be fine after that).

Sorry for the confusion trying to sort out the issue -- I appreciate you sticking with us and helping us sort out the issue.
It's embarrassing that our user base found and reported the issue before we did -- and I apologize for that.
(We have robo-checks for full disks running 24x7 -- but in this sort case, it hit 100%, fatal-ed, then disk cleaned up very quickly so we never hit a threshold trigger).

I'd make the script more bulletproof to a fail like this -- but we are replacing the Search Engine w/i the next 15-90 days...

Best regards, and thanks for putting up with our little glitches from time to time!
-Tracey

Reply [edit]

Poster: geekcookiespodcast Date: Jul 16, 2015 10:14am
Forum: forums Subject: Re: Library View Count Not Updating

Hi,
thans!

It's really amazing you find time to solve this tiny issue, I can barely imagine the volume of stuff you have to work on in this website.

I'm really happy I can rely on the json now, I really didn't want to write a cumbersone parser (I'm really bad at it :-)

That is an example of what I was tracking for the first of my upload

http://www.charted.co/?{%22dataUrl%22%3A%22http%3A%2F%2Fgeekcookies.brapi.net%2Fgeekcookies_ep_0.csv%22}

Thank you and keep up the good work!

Reply [edit]

Poster: tracey pooh Date: Aug 7, 2015 7:18pm
Forum: forums Subject: Re: Library View Count Not Updating

ok, all the individual shows should be updated now (finally).

happy weekend!

Reply [edit]

Poster: CaseUploader155 Date: Sep 19, 2015 11:51am
Forum: forums Subject: Re: Library View Count Not Updating

I need your help. My view count for the criminal case files I uploaded has stopped at 300. My friends were showing these case files to some lawyers and then the view count stopped at 300 for days and days without any additional update. Please fix the view count on my case files pdf upload please?

https://archive.org/details/USAvHill

Also those documents came from PACER so they are public record and can legally be uploaded under federal law. Just needed to note that. Also I ask that you not Judge the person named in those case files as he is trying to prove Actual Innocence to his charge. Thee documents in that upload are uploaded for the purpose of putting the truth on the public record.

Please I beg of you to fix the view count as I believe the documents are getting a lot of views due to the nature of this criminal case and the fact that the Defendant is persistent in trying to prove Actual Innocence to the crime he was indicted on. I know the views are higher then 300 but it is stuck at 300.

Reply [edit]

Poster: geekcookiespodcast Date: Jul 17, 2015 4:56am
Forum: forums Subject: Re: Library View Count Not Updating

Hi,
just to let you know, it seems the script failed in the last night run:

the top element "geekcookies_ep_8" show 161 views in the search :
https://archive.org/search.php?query=uploader%3A%22geekcookiespodcast%40gmail.com%22&sort=-publicdate

and 173 in the element page itself:
https://archive.org/details/geekcookies_ep_8

I'll wait for your Search Engine upgrade,
thank you!



This post was modified by geekcookiespodcast on 2015-07-17 11:56:16