Opened 6 years ago

Last modified 4 years ago

#1327 closed change

Migrate adblockplus.org/forum data from phpBB to Discourse — at Version 8

Reported by: kzar Assignee:
Priority: P3 Milestone:
Module: Infrastructure Keywords: phpbb forum discourse
Cc: kzar, trev, arthur, mapx, greiner, matze Blocked By:
Blocking: Platform: Unknown
Ready: yes Confidential: no
Tester: Unknown Verified working: no
Review URL(s):

Description (last modified by trev)

Background

We want to replace phpBB with Discourse for the Adblock Plus user forum.

phpBB forum is our most used system, the one where we get most user interaction. It is also the crappiest one, not to mention outdated and too hard to update. A project to have it replaced has been picked up a few times over the years, the progress has been negligible because nobody can focus on it. We should consider adding this to the roadmap.

  • palant

What to change

The aim is to import all the content over from phpBB to a locally running Discourse dev server. When that has been thoroughly adblockplus.org/forum can be migrated over. (There are existing third party migration scripts in the resources list below, they might need to be developed further to ensure a smooth migration during the process of this ticket.)

What we need to import:

  • Forum posts
  • User accounts (without passwords, the email address should be sufficient to log in with Google & Co.) - only the ones who actually posted something, we have a massive number of dead spammer accounts there.
  • Subforums should be mapped to categories, e.g. "Adblock Plus for Firefox" will become the "firefox" category. We will create the necessary category and configure permissions for them manually.
  • Group memberships and ranks don't need to be converted, we can do that manually.

Resources

http://www.discourse.org/
https://meta.discourse.org/t/importing-phpbb-into-discourse/7956
https://github.com/cfstras/discourse-import-phpBB

Change History (9)

comment:1 Changed 6 years ago by kzar

Without access to the adblock.com/forum database and files this ticket is unworkable IMHO, we need to test the migration script works in practice with our data. I think therefore this ticket is blocked until someone with access to the data has time to work on the migration.

comment:2 Changed 6 years ago by kzar

  • Cc dave@… added
  • Owner kzar deleted

comment:3 follow-up: Changed 6 years ago by philll

  • Cc kzar trev added; dave@… removed

@trev: I guess it would be sufficient to provide some test dump to get this done by somebody without direct access to the database.

However, this Issue lacks a lot of concept, which is required to do such a migration with some specs about how logically to migrate subthreads, what to show on the start page, how to logically take over permissions etc.

comment:4 in reply to: ↑ 3 Changed 6 years ago by kzar

Yea I was thinking that, @snoack was saying how there's sensitive data like password hashes and private messages but perhaps it would be possible to strip them all out of the dump with a regexp? (Like set all passwords to a hash of "password" and the private messages with lorem ipsum or something appropriate.)

@phill you're right there's a lot of questions about what happens in various situations. I've not thought them through at all really to be honest! I thought the best place to start was to test see what actually happens in practice and then from that we could realise where the problem areas are and decide the best course of action for them all. That said if you guys have ideas about some of those things already post away I guess!

Replying to philll:

@trev: I guess it would be sufficient to provide some test dump to get this done by somebody without direct access to the database.

However, this Issue lacks a lot of concept, which is required to do such a migration with some specs about how logically to migrate subthreads, what to show on the start page, how to logically take over permissions etc.

Last edited 6 years ago by kzar (previous) (diff)

comment:5 Changed 6 years ago by trev

  • Description modified (diff)
  • Priority changed from Unknown to P3
  • Ready set
  • Summary changed from Replace adblockplus.org/forum phpBB with Discourse to Migrate adblockplus.org/forum data from phpBB to Discourse

I updated the description and title. Note that this is only about migrating the data now, actually setting up a public Discourse instance should be a separate issue.

comment:6 Changed 6 years ago by trev

  • Review URL(s) modified (diff)

comment:7 Changed 6 years ago by trev

  • Description modified (diff)

comment:8 Changed 6 years ago by trev

  • Description modified (diff)

Changed 6 years ago by trev

Cleaned up forum database dump

Note: See TracTickets for help on using tickets.