Saved RDF threads - thank you

A forum to talk about other sites and things you've found in the jungle that is the internet.

Please take a moment to read the rationalia guidelines: http://rationalia.com/forum/viewtopic.php?f=3&t=3449
Post Reply
User avatar
GenesForLife
Bertie Wooster
Posts: 1392
Joined: Sat Aug 08, 2009 6:44 pm
Contact:

Re: Saved RDF threads - thank you!

Post by GenesForLife » Thu Feb 25, 2010 6:47 pm

Excuse me, can this sort the problem with the search function?

Code: Select all

Search within a specific website (site:)
Google allows you to specify that your search results must come from a given website. For example, the query [ iraq site:nytimes.com ] will return pages about Iraq but only from nytimes.com. The simpler queries [ iraq nytimes.com ] or [ iraq New York Times ] will usually be just as good, though they might return results from other sites that mention the New York Times. You can also specify a whole class of sites, for example [ iraq site:.gov ] will return results only from a .gov domain and [ iraq site:.iq ] will return results only from Iraqi sites.

User avatar
NineBerry
Tame Wolf
Posts: 9100
Joined: Thu Feb 26, 2009 1:35 pm
Location: nSk
Contact:

Re: Saved RDF threads - thank you!

Post by NineBerry » Fri Feb 26, 2010 2:25 am

Okay, here is my status.

There are altogether 110,313 threads.

74,395 of those have been safely and fully downloaded.

In these, there are together 1,968,794 posts that are already save on my hard drive. 26,414 different users have contributed to these posts.

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.2 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.2 MB)

Most of the links in those files don't work yet, because the other files are not there yet. Here is what an automatically generated table of contents for one user looks like: http://www.neunbeere.de/rd.net/Users/24276.html (270 kb)

29,484 threads are forever lost. Those are threads that have been deleted at some point during the life of rd.net by administrators, those that are not accessible to me (because they are in mod central e.g.) and those that are empty because their posts have been merged with other threads.

6,434 threads are still pending. These will be downloaded over the next hours.

Here is what I still have to do:

1. Wait until the pending 6,000 threads have been downloaded
2. Then create final table of contents for all users
3. Download avatars from rd.net for all users
4. If all that is finished: Adapt the actual forum files to fix internal links and remove content that is not needed
5. Then package everything together and give to anyone who wants it.

:td:

RPizzle
Posts: 556
Joined: Fri Jun 19, 2009 4:23 pm
Contact:

Re: Saved RDF threads - thank you!

Post by RPizzle » Fri Feb 26, 2010 2:41 am

NineBerry wrote:Okay, here is my status.

There are altogether 110,313 threads.

74,395 of those have been safely and fully downloaded.

In these, there are together 1,968,794 posts that are already save on my hard drive. 26,414 different users have contributed to these posts.

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.2 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.2 MB)

Most of the links in those files don't work yet, because the other files are not there yet. Here is what an automatically generated table of contents for one user looks like: http://www.neunbeere.de/rd.net/Users/24276.html (270 kb)

29,484 threads are forever lost. Those are threads that have been deleted at some point during the life of rd.net by administrators, those that are not accessible to me (because they are in mod central e.g.) and those that are empty because their posts have been merged with other threads.

6,434 threads are still pending. These will be downloaded over the next hours.

Here is what I still have to do:

1. Wait until the pending 6,000 threads have been downloaded
2. Then create final table of contents for all users
3. Download avatars from rd.net for all users
4. If all that is finished: Adapt the actual forum files to fix internal links and remove content that is not needed
5. Then package everything together and give to anyone who wants it.

:td:
Thanks for all the hard work.

User avatar
theropod
Posts: 34
Joined: Wed Feb 24, 2010 1:58 am
Contact:

Re: Saved RDF threads - thank you!

Post by theropod » Fri Feb 26, 2010 2:53 am

I would very much to have a copy of this effort when it is compiled in what can be considered a final form.

I would much more like to see this all set up in a format on the net maybe just as a read only archive that actually had a functional search feature. I think we could live without avatars but if someone wants to include them oh well.

Anyway I will be watching this thread and eager to contribute some support if possible.

RS
"Sleeping in the hen house doesn't make you a chicken."
14 years off-grid and counting

NineOneFour
Posts: 328
Joined: Tue Feb 23, 2010 11:27 am
About me: Married, ethnically German, hardcore Social Democrat, ex-Dittohead, ex-Libertarian, went to Catholic school, father was a religious cultist who thought he had the gift of prophecy and could communicate with the "other side".
..............................
So, had a weird life. Better now.
Location: Surrounded by fundies and mutants in Texas
Contact:

Re: Saved RDF threads - thank you!

Post by NineOneFour » Fri Feb 26, 2010 2:55 am

NineBerry wrote:Okay, here is my status.

There are altogether 110,313 threads.

74,395 of those have been safely and fully downloaded.

In these, there are together 1,968,794 posts that are already save on my hard drive. 26,414 different users have contributed to these posts.

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.2 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.2 MB)

Most of the links in those files don't work yet, because the other files are not there yet. Here is what an automatically generated table of contents for one user looks like: http://www.neunbeere.de/rd.net/Users/24276.html (270 kb)

29,484 threads are forever lost. Those are threads that have been deleted at some point during the life of rd.net by administrators, those that are not accessible to me (because they are in mod central e.g.) and those that are empty because their posts have been merged with other threads.

6,434 threads are still pending. These will be downloaded over the next hours.

Here is what I still have to do:

1. Wait until the pending 6,000 threads have been downloaded
2. Then create final table of contents for all users
3. Download avatars from rd.net for all users
4. If all that is finished: Adapt the actual forum files to fix internal links and remove content that is not needed
5. Then package everything together and give to anyone who wants it.

:td:

Wow, you are the man.

User avatar
HughMcB
Posts: 157
Joined: Mon Feb 22, 2010 10:59 pm
Location: Toronto, Canada. . . . . . . . . . . . . (natural habitat: Ireland)

Re: Saved RDF threads - thank you!

Post by HughMcB » Fri Feb 26, 2010 3:12 am

Excellent work NineBerry! :tup:
Timonenfail wrote:We are all very excited about the new changes.
Quote-mine Dawkins wrote:If I ever had any doubts that RD.net needs to change, and rid itself of this particular aspect of Internet culture, they are dispelled by this episode.

User avatar
Valden
Posts: 651
Joined: Mon Feb 22, 2010 11:12 pm
About me: Once upon a time...
Location: Peyton, Colorado, U.S
Contact:

Re: Saved RDF threads - thank you!

Post by Valden » Fri Feb 26, 2010 4:29 am

NineBerry wrote:Okay, here is my status.

There are altogether 110,313 threads.

74,395 of those have been safely and fully downloaded.

In these, there are together 1,968,794 posts that are already save on my hard drive. 26,414 different users have contributed to these posts.

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.2 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.2 MB)

Most of the links in those files don't work yet, because the other files are not there yet. Here is what an automatically generated table of contents for one user looks like: http://www.neunbeere.de/rd.net/Users/24276.html (270 kb)

29,484 threads are forever lost. Those are threads that have been deleted at some point during the life of rd.net by administrators, those that are not accessible to me (because they are in mod central e.g.) and those that are empty because their posts have been merged with other threads.

6,434 threads are still pending. These will be downloaded over the next hours.

Here is what I still have to do:

1. Wait until the pending 6,000 threads have been downloaded
2. Then create final table of contents for all users
3. Download avatars from rd.net for all users
4. If all that is finished: Adapt the actual forum files to fix internal links and remove content that is not needed
5. Then package everything together and give to anyone who wants it.

:td:
:cheers: Sounds wonderful! Thank you for doing this.

User avatar
macdoc
Twitcher
Posts: 8861
Joined: Tue Feb 23, 2010 3:20 pm
Location: BirdWing Home FNQ
Contact:

Re: Saved RDF threads - thank you!

Post by macdoc » Fri Feb 26, 2010 4:39 am

Brilliant :td:
Resident in Cairns Australia • Current ride> 2014 Honda CB500F • Travel photos https://500px.com/p/macdoc?view=galleries

User avatar
fuck you & fuck your god
Posts: 103
Joined: Mon Feb 22, 2010 9:41 pm
About me: aka mechtheist
Off my meds again
Location: No where near Uganda
Contact:

Re: Saved RDF threads - thank you!

Post by fuck you & fuck your god » Fri Feb 26, 2010 5:33 am

Great job Nineberry, I want a copy at some point.
Many thanks for all the effort.
Image Image Image
Is life not a hundred times too short for us to stifle ourselves--Nietzsche

User avatar
MrFungus420
Posts: 881
Joined: Sat Mar 14, 2009 4:51 pm
Location: Midland, MI USA
Contact:

Re: Saved RDF threads - thank you!

Post by MrFungus420 » Fri Feb 26, 2010 7:00 am

That is just incredible work, nineberry. Thank you.

Looks like enough people (myself included) want it that you might want to use a file-sharing site and just post a link for it.
P1: I am a nobody.
P2: Nobody is perfect.
C: Therefore, I am perfect

lpetrich
Posts: 303
Joined: Wed Feb 24, 2010 8:59 pm
Contact:

Re: Saved RDF threads - thank you!

Post by lpetrich » Fri Feb 26, 2010 8:15 am

NineBerry wrote:Okay, here is my status.

There are altogether 110,313 threads.

74,395 of those have been safely and fully downloaded.

In these, there are together 1,968,794 posts that are already save on my hard drive. 26,414 different users have contributed to these posts.

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.2 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.2 MB)
Great job, Nineberry. But for comparisons to others' work, it would be useful to have the thread ID's and parent-forum ID's for each one. Did you save them also?

Spearthrower
Posts: 41
Joined: Tue Feb 23, 2010 2:57 pm
Contact:

Re: Saved RDF threads - thank you!

Post by Spearthrower » Fri Feb 26, 2010 9:07 am

NineBerry wrote:Okay, here is my status.

There are altogether 110,313 threads.

74,395 of those have been safely and fully downloaded.

In these, there are together 1,968,794 posts that are already save on my hard drive. 26,414 different users have contributed to these posts.

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.2 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.2 MB)

Most of the links in those files don't work yet, because the other files are not there yet. Here is what an automatically generated table of contents for one user looks like: http://www.neunbeere.de/rd.net/Users/24276.html (270 kb)

29,484 threads are forever lost. Those are threads that have been deleted at some point during the life of rd.net by administrators, those that are not accessible to me (because they are in mod central e.g.) and those that are empty because their posts have been merged with other threads.

6,434 threads are still pending. These will be downloaded over the next hours.

Here is what I still have to do:

1. Wait until the pending 6,000 threads have been downloaded
2. Then create final table of contents for all users
3. Download avatars from rd.net for all users
4. If all that is finished: Adapt the actual forum files to fix internal links and remove content that is not needed
5. Then package everything together and give to anyone who wants it.

:td:

Can we have love-children together?

:qoti:

WhostolemyID
Posts: 21
Joined: Wed Feb 24, 2010 4:49 pm
Contact:

Re: Saved RDF threads - thank you!

Post by WhostolemyID » Fri Feb 26, 2010 9:30 am

Serious thanks to all you downloaders - who seem to know what you are doing rather better than I understand it. :think:

I was never a heavy poster on RD, as indicated that this is my second post on this (very fine) forum, so it's not my work that'd be lost. However, I was a heavy reader there, and was always stunned at the quality of some posting there. To lose it would be, to my simplistic mind, akin to boo-burning, as others have said.

It's clear that some people are still willing to volunteer their time, effort & skill for little more than a "thank you".

Thank you!

Edit to add: I'd quite willingly donate to a charity** of choice, and defray any costs incurred, in order to get a copy.

**Well, not any charity.... ;)

User avatar
NineBerry
Tame Wolf
Posts: 9100
Joined: Thu Feb 26, 2009 1:35 pm
Location: nSk
Contact:

Re: Saved RDF threads - thank you!

Post by NineBerry » Fri Feb 26, 2010 11:24 am

lpetrich wrote:
NineBerry wrote: Great job, Nineberry. But for comparisons to others' work, it would be useful to have the thread ID's and parent-forum ID's for each one. Did you save them also?
The thread ids are already used as file names. In ".../Pages/1-0.html" the 1 is the thread id. I could extract forum ids at a later point, but that is not what I am looking at right now. I don't think it's necessary. The thread is enough to identify a thread.

User avatar
Ronja
Just Another Safety Nut
Posts: 10920
Joined: Wed Feb 24, 2010 8:13 pm
About me: mother of 2 girls, married to fellow rat MiM, student (SW, HCI, ICT...) , self-employed editor/proofreader/translator
Location: Helsinki, Finland, EU
Contact:

Re: Saved RDF threads - thank you!

Post by Ronja » Fri Feb 26, 2010 3:11 pm

Spearthrower wrote:
I'll happily cough up postage, packaging, disc cost, labour costs, price of tea consumed while downloading the thing, proportion of electricity bill.... just put me down for one! :tup:
ditto, great work guys! :clap: :clap:
"The internet is made of people. People matter. This includes you. Stop trying to sell everything about yourself to everyone. Don’t just hammer away and repeat and talk at people—talk TO people. It’s organic. Make stuff for the internet that matters to you, even if it seems stupid. Do it because it’s good and feels important. Put up more cat pictures. Make more songs. Show your doodles. Give things away and take things that are free." - Maureen J

"...anyone who says it’s “just the Internet” can :pawiz: . And then when they come back, they can :pawiz: again." - Tigger

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests