xboxscene.org forums

Off Topic Forums => General Chat => The Dump => Topic started by: Iriez on June 23, 2021, 11:48:39 AM

Title: Xbox-Scene forums are back!!!
Post by: Iriez on June 23, 2021, 11:48:39 AM
Hello to all! After 5 years of downtime the team @ xbins.org (romracer and myself) as well as CrunchBite (X-Link Kai dev) has brought the forums back to life after 3 years of painstaking recovery. We originally tried to do this in 2018 but were unsatisfied with the incompleteness of the database. I have asked CrunchBite to make a post detailing the process so that you can all be aware of the extensive work put into this project. Special thanks to Milenko for donating the xboxscene.org the domain and /u/xboxexpert for the partial backup that was the foundation of this work. At this time we still do not have access to the xbox-scene.com domain.


As it stands right now the forum is almost entirely functional with a few kinks to iron out. Old forum links will redirect to the new domain automagically but we cannot make links that have old/incompatible paths or missing posts appear. Unfortunately with the archive scraper and old rip we had to rebuild the database to work with SMF, which means the old topic IDs will not match with the new ones. Simply put, URL redirects wont work correctly and will instead just reload the home forums page. Old posts quote brackets didn't import right and would take quite a bit of work to rework the database so we are going to leave that as-is.  Crunchbite put a monumental effort into taking the partial backup that was created in /u/xboxexpert's reddit post (https://www.reddit.com/r/originalxbox/comments/78qmop/xboxscenecom_forums/) and making it as complete as possible. However, there are a portion of posts that will be lost to the internet forever, unless Xantium decides to come back. We have put a significant effort to track him down through the years and know he's still alive because he keeps renewing the domain. A person managed to recover his old email in an attempt to get the domain back but cannot as Xantium keeps renewing before expiry. Milenko even tracked down a person in belgium who matched all of the info we have but he has stated he doesn't even own an xbox. I think that for whatever reason Xantium moved on and wants to not be associated with the project anymore. We do wish he would contact us and hand over the domain registration and any backups he has so we can properly preserve the decade + of knowledge that was contained in the xbox-scene forums. As it stands we currently have 1,545,490 Posts in 184018 Topics by 455530 Members recovered on this forum, with 283,201 of those posts being recovered via Crunchbite in addition to xboxhackers HTTrack rip.

This forum is not just intended to be a backup - but an actual continuation of the original forums. You will be able to post new content, reply to old threads, etc. We have even setup a old account recovery portal for those of you who can remember your old username/email/password. If you can, you can recover your original account and start posting again  :beer:. If you are a old moderator or significant contributor and still have access to your old email but cannot remember your password, I will consider restoring your original account on a one by one basis if you have enough proof. You may feel free to PM me on this issue, but be warned I will ignore anyone who was not a significant contributor. This option is not for 99.9% of the users on the forum, so please don't blow up my inbox if you cannot remember your password. Just make a new account and start fresh :)

You can attempt to recover your account here - https://xboxscene.org/recoveryportal/ (https://xboxscene.org/recoveryportal/)

I would like to take this moment to let everyone know that xbins has always been a community driven project with work supplied by open contributors through the past 2 decades. A special thanks to Parnic, Spiral, Fedex and Cr4zi3 for their dedication through the years and the biggest thanks to romracer for most of the heavy lifting, who if didn't exist I probably would have given up a decade ago.

With that said - We would really like anyone who has web back end experience or design/UI experience to reach out to us if you can help. At this point we have no support team to work on web-based issues, so any issues on the forum will likely remain issues until I can find someone willing to contribute. I would encourage everyone who uses this forum to report any bugs they find in this thread for us to document and we hope that someone(s) will step forward to help with the project to resolve.

At one point xbox-scene was a top 5,000 Alexa website, and xbins handling millions of unique IP addresses per month on the FTP alone. We were two powerhouses, always brother-sister sites. I was the only admin capable of posting on the front page for a few years when xantium disappeared and eventually I lost my access after a HD failure. The site stayed alive a few more years, disappeared, and then the forums popped back up online for a brief time when Xantium restored them, though still didn't come out of hiding. They quickly went down again in 2016 and have been down since.

Thanks to everyone who has ever contributed to the xbox hacking community, without all of you we wouldn't be here today!
Title: Re: XS is back!!!
Post by: CrunchBite on June 23, 2021, 12:09:43 PM
From the technical side restoring the forum was a long process full of many late nights. Here is how it was done  ;D

The general process is:
1. Obtain a copy of an old topic as a web page.
2. Extract the post text, author, post dates, etc.
3. Rebuild the topics and posts in a database as those separate components.
4. Recreate the content in new forum software.

Let's break this down step by step:
1. Getting the old data
Believe it or not this was the easiest part. There are a couple 'backups' of the xbox-scene forum out there that have a large portion of the 4,797,459 posts (thanks xboxexpert!) but sadly none are complete. So where do you get more? The Internet Archive's Wayback Machine of course! Using a tool for ripping entire websites from IA I retrieved every capture the wayback machine had of forums.xbox-scene.com.

Okay we've got 1,887,080 HTML files. Now what?

2. Extracting the content
To extract the post body, author, post date, topic title etc we have to commit the ultimate programming sin: parsing HTML with regular expressions.
Since the captures from IA and the various backups were from different points in time the page styling and underlying HTML were not consistent. This meant having to write ~20 different parsers to extract the necessary data. The final results were then stored in a database for easier processing.

3. Cleaning, sorting, and deduplicating
Now that I had post body, author, date, topic title, post ID (so helpful), etc the next step was deduplicating and weeding out obvious parsing failures. This was done with a series of scripts using some really nasty regex and resulted in 1,545,492 posts in 184,019 topics. Just 32% of the original forum content. :s_cry: They say what you post on the internet is forever. Sadly, not in this case.

4. Recreation
The final step is turning this nicely laundered content into a usable forum. I chose to use Simple Machines Forum (SMF) for this as the database schema was incredibly simple to work with and after writing a couple functions I could easily inject user accounts, topics, and posts. The rest of the work was pretty straight forward; inject all the users, inject all the topics, inject all the posts. The most tedious process was manually creating the forum board structure and associating topics to their correct forums. (Surprise, there was more regex involved).
The final result was a functional forum that suddenly was looking awfully familiar!

To wrap it up I recreated the IPB theme of ~2005 era X-S as an SMF theme for maximum nostalgia.  ;D
Title: Re: XS is back!!!
Post by: kaos_engr on June 23, 2021, 08:46:40 PM
Excellent work! 

Able to recover my old account.
Title: Re: XS is back!!!
Post by: jazzycian on June 24, 2021, 01:24:13 AM
Great work guys, I hope everyone appreciates the work that goes into something like this.

Recovered my old account too from when I was way younger than I am now hahaha  :sifi3:
Title: Re: XS is back!!!
Post by: T3chWarrior on June 24, 2021, 01:35:32 AM
Great news, glad to have it back. Thank you for the work!
Title: Re: XS is back!!!
Post by: fallenangle on June 24, 2021, 04:27:01 AM
Yes, welcome back.

My old password/email didn't work but the account recovery tool did so here I am.  :)

Do not want to get too nostalgic but at one point just before the start of the last extended hiatus there seemed to be only two regular posters on the original Xbox boards, myself being one of them.

Please, please tell me that this resurrection has done away with most of the stupidly strict and noob unfriendly TOS conditions and 'welcome'. Utterly self-defeating if you're trying to create a forum which attracts traffic.

Due to the fact I was not using a PC but a set top box at the time which did not display some content on many web sites in full I accidentally (twice) posted links to web sites that included links to copyrighted material.

That meant a two week ban for the second instance and permanently shown on my account as 2 warnings from then on. That irked me greatly as a loyal and, I hope, helpful poster long after most other regulars had left too.
     
Title: Re: XS is back!!!
Post by: rob1309 on June 24, 2021, 06:30:22 AM
Was pleasantly surprised to see this when I woke this morning.
Thanks so much!!!  :b_beer2: :beer:
Title: Re: XS is back!!!
Post by: Iriez on June 24, 2021, 05:42:40 PM
Was pleasantly surprised to see this when I woke this morning.
Thanks so much!!!  :b_beer2: :beer:

That is correct, you cannot just login with your old username/password. You must recover it first! Old users are in a seperate archived user group which does not have permissions. Only recovered accounts will have posting permissions.

Glad to have you back.
Title: Re: Xbox-Scene forums are back!!!
Post by: Alex548 on June 25, 2021, 11:40:17 PM
Welcome back. :beerchug:
It appears account recovery doesn't restore our mod status, but at least There's a semi functional site again.
Before the site went down for good Xantium had already been MIA and HSDEMONZ also gave his farewell in head mod chat. Nobody had access to front page except Iriez and GaryOPA. All news stories were linked to maxconsole if I remember correctly. I spent most of my time moving spam posts to the garbage in the last few weeks before the site finally went down.
I still have my x-s shirt in the closet . . . Somewhere. shirt hasn't fit me in forever, but still held onto it  Lol
Title: Re: Xbox-Scene forums are back!!!
Post by: MasterGouken on June 26, 2021, 01:24:37 AM
Awesome work guys, managed to recover my account no problem  :b_beer2:
So glad to see this forum back, i spent way too much time on it back in the day  :D
Title: Re: Xbox-Scene forums are back!!!
Post by: romracer on June 26, 2021, 05:53:05 AM
Welcome back. :beerchug:
It appears account recovery doesn't restore our mod status, but at least There's a semi functional site again.
Before the site went down for good Xantium had already been MIA and HSDEMONZ also gave his farewell in head mod chat. Nobody had access to front page except Iriez and GaryOPA. All news stories were linked to maxconsole if I remember correctly. I spent most of my time moving spam posts to the garbage in the last few weeks before the site finally went down.
I still have my x-s shirt in the closet . . . Somewhere. shirt hasn't fit me in forever, but still held onto it  Lol

It does not restore your mod status.  And we actually flagged some users as not recoverable due to various reasons.  You can talk to Iriez about regaining previous status though.
Title: Re: Xbox-Scene forums are back!!!
Post by: Mr_Milenko on June 26, 2021, 06:46:04 PM
It's a thing of beauty. Knowing some of the stuff that's been going on in the background has had me excited for this project, and in all honesty it's one of the key factors in us putting together a discord, as well as re-registering some TeamUIX/tHc/BSX related accounts and websites (fucking squatters got to some of them).

Let me know when I can brag about this, I also have the @xbox_scene twitter handle if anyone wants to take that over, or I can just use it to relay messages, it's a bit dead at the moment.
Title: Re: Xbox-Scene forums are back!!!
Post by: ILTB on June 26, 2021, 07:04:41 PM
GG all :)
 :egypt:
Title: Re: Xbox-Scene forums are back!!!
Post by: Mr_Milenko on June 26, 2021, 07:16:30 PM
GG all :)
 :egypt:

Theres one I know! :D
Title: Re: Xbox-Scene forums are back!!!
Post by: Hazeno on July 01, 2021, 02:48:10 PM
Well done Crunch and Team, After spending about 40 minutes trying to remember my old pass i finally made it!
Title: Re: Xbox-Scene forums are back!!!
Post by: HoRnEyDvL on July 01, 2021, 03:37:55 PM
Well done Gents.. Feels good to finally be back home!!!!
Title: Re: Xbox-Scene forums are back!!!
Post by: AmyGrrl on July 01, 2021, 05:50:53 PM
Good to see this site back up. I was also able to recover my account.
Title: Re: Xbox-Scene forums are back!!!
Post by: freakdave on July 01, 2021, 10:41:17 PM
What a blast from the past. It's great to see this place thriving again!
Title: Re: Xbox-Scene forums are back!!!
Post by: InsaneNutter on July 02, 2021, 12:28:51 PM
Amazing work and a big thank you to all involved with brining back such an important part of Xbox history.

Needless to say what happened in the early days of the Xbox Scene did have some influence on future Xbox consoles: https://arstechnica.com/gaming/2006/06/4415/ - so its great a significant part of history now accessible once more.

I'll be sure to share news and hopefully alert others that Xbox-Scene is back.
Title: Re: Xbox-Scene forums are back!!!
Post by: Hexx on July 03, 2021, 08:55:56 AM
 :2:

We're back, baby!
Title: Re: Xbox-Scene forums are back!!!
Post by: Iriez on July 06, 2021, 12:29:52 PM
Amazing work and a big thank you to all involved with brining back such an important part of Xbox history.

Needless to say what happened in the early days of the Xbox Scene did have some influence on future Xbox consoles: https://arstechnica.com/gaming/2006/06/4415/ - so its great a significant part of history now accessible once more.

I'll be sure to share news and hopefully alert others that Xbox-Scene is back.

xbins has logged thousands of microsoft IP's hitting the ftp for apps/tools. MS loves the modding community =)
Title: Re: Xbox-Scene forums are back!!!
Post by: xmod4u on July 07, 2021, 01:20:14 PM
OMG!!!
20 years later, you guys are freaking crazy!!!
everything is still here!!

amazing work guys, love it!!

IM BACK
Title: Re: Xbox-Scene forums are back!!!
Post by: kyle90316 on July 14, 2021, 04:58:48 PM
 :pop:
Title: Re: Xbox-Scene forums are back!!!
Post by: Hyper_Eye on July 18, 2021, 11:27:02 PM
Welcome back! :vik:
Title: Re: Xbox-Scene forums are back!!!
Post by: ximmortalxxkingx on July 22, 2021, 06:40:01 PM
Wow, never thought i'd be posting here again, especially with my old account and all 16+ years later. Thanks for restoring all of this and all the memories! I was coming here all the time as a 15 year old kid learning linux and trying to set up servers on the xbox. Now im in my 30s and work in cloud, probably thanks to the skills i learned back then. Thanks again, this is so great.   :beerchug:
Title: Re: Xbox-Scene forums are back!!!
Post by: ftf death on July 22, 2021, 07:08:57 PM
Wow, never thought i'd be posting here again, especially with my old account and all 16+ years later. Thanks for restoring all of this and all the memories! I was coming here all the time as a 15 year old kid learning linux and trying to set up servers on the xbox. Now im in my 30s and work in cloud, probably thanks to the skills i learned back then. Thanks again, this is so great.   :beerchug:

life a roller coaster
Title: Re: Xbox-Scene forums are back!!!
Post by: tuxuser on August 14, 2021, 05:03:24 PM
Welcome back X-S!!

Now let's get to business to restore the main news portal :P
Title: Re: Xbox-Scene forums are back!!!
Post by: Doc Gonzo on August 15, 2021, 11:26:55 AM
Thanks to all the helping hands who made this possible. :b_love2:
Title: Re: Xbox-Scene forums are back!!!
Post by: ampedXR on August 26, 2021, 10:30:30 PM
holy crap!!!

The good ol days are back!

It's such an insane feeling to go through all my old posts! Thanks folks!
Title: Re: Xbox-Scene forums are back!!!
Post by: Maverick-DBZ- on October 05, 2021, 10:57:32 PM
Holy cow, it's back!

I couldn't remember my old email address to reset my password, so I can only imagine what void/black-hole it went to, mostly likely AOL, Yahoo, or Hotmail, but thankfully the recover portal link worked with what I remembered 8)

Reading over my old posts sure brings back memories. 8)
Title: Re: Xbox-Scene forums are back!!!
Post by: HoRnEyDvL on October 29, 2022, 03:57:55 PM
You can also join the discord

Https://discord.gg/VcdSfajQGK

Title: Re: Xbox-Scene forums are back!!!
Post by: wmxp on April 27, 2023, 05:23:03 AM
Hell yes! Just found out about this recovery project via https://consolemods.org/wiki/Xbox:Scene_History and I joined their discord in efforts to aid the timeline. Amazed to see you still kicking Iriez!  :b_love1:
Title: Re: Xbox-Scene forums are back!!!
Post by: namek0 on May 23, 2023, 07:47:44 PM
good to be back! feels like a lifetime ago yet my og xbox is still going strong thankfully! So cool to see the old gang again
Title: Re: Xbox-Scene forums are back!!!
Post by: StrictPuppet on October 19, 2023, 10:09:30 PM
It is like visiting an old friend.
Title: Re: Xbox-Scene forums are back!!!
Post by: hamwbone on January 02, 2024, 08:55:43 PM
It is like visiting an old friend.

Hello old friend!
Title: Re: Xbox-Scene forums are back!!!
Post by: VastGsm on February 13, 2024, 05:52:40 AM
I'm back finally after recovering my account. Thank you to whoever thought of the legacy account recovery. Honestly, that was a GodSend cheers 🫡
Title: Re: Xbox-Scene forums are back!!!
Post by: oz_paulb on February 15, 2024, 07:00:19 PM
nice work recovering the forums!

looking at old posts makes me feel extra old :)

- Paulb


EDIT: looks like you may have a SPAM issue on the new forum, though.  I see a TON of posts (on pretty much every forum) from “ Montanazdg”