Opened on 03/11/2014 at 04:45:38 PM

Closed on 03/20/2015 at 08:01:25 AM

Last modified on 03/20/2015 at 08:01:39 AM

#51 closed change (fixed)

Set up Rietveld on our own infrastructure

Reported by: christian Assignee: matze
Priority: P3 Milestone:
Module: Infrastructure Keywords:
Cc: fhd, sebastian, trev Blocked By:
Blocking: #2182 Platform: Unknown
Ready: no Confidential: no
Tester: Verified working: no
Review URL(s):

Description (last modified by fhd)


We want to have Rietveld running on our own infrastructure.

What to change

  • Write Exporter
  • Write Importer
  • Test Importer
  • Write Puppet Scripts
  • Set up user accounts

Attachments (0)

Change History (19)

comment:1 Changed on 03/11/2014 at 09:29:05 PM by trev

  • Description modified (diff)
  • Summary changed from Setting up rietveld on our own Infrastructur to Set up Rietveld on our own infrastructure

comment:2 Changed on 03/12/2014 at 10:16:56 PM by fhd

  • Reporter changed from philll to fhd

comment:3 Changed on 03/12/2014 at 10:17:16 PM by fhd

  • Status changed from new to assigned

comment:4 Changed on 03/12/2014 at 10:18:05 PM by fhd

  • Description modified (diff)
  • Reporter changed from fhd to christian

comment:5 Changed on 03/12/2014 at 10:18:23 PM by fhd

  • Priority changed from Unknown to P3

comment:6 Changed on 04/14/2014 at 04:31:25 PM by fhd

  • Cc fhd added
  • Ready unset

comment:7 Changed on 04/15/2014 at 07:50:09 AM by christian

just a short round up over the rietveld status:

  • Deploying works
  • Getting all data out of rietveld
  • Setting the right issue numbers at import
  • Getting the comments to the issues
  • Setting meta information like owner
  • Extend API to change the meta information with a script
  • Import script works pretty stable, need more error handling

Not working:

  • change the ID of the patchsets, because the ID have to be global uniq and not uniq in context of the issue -> rewrite with a htaccess
  • The comments are not shown in the diffs inline, there is no API maybe some little changes in the database can help -> start testing this and extend import script

comment:8 Changed on 04/30/2014 at 09:50:33 AM by philll

  • Status changed from assigned to new

The assigned state will be dropped by #403

comment:9 Changed on 06/23/2014 at 10:39:40 AM by sebastian

  • Cc sebastian added

comment:10 Changed on 06/27/2014 at 01:01:59 PM by christian

Write a little bit of how to make a rietveld migration. It will be updatet and correct and you can find it here

# Manual for rietveld migration

I would recommend to use vagrant for running an testing, you have to install django to get this working.

  • Create a folder rietveld and cd in it
  • Download all migration scripts
  • hg clone and cd in it.
  • Change in the folder examples/rietveld and open the Makefile and change the hg repo link to "hg clone ssh:// -r importer rietveld.hg" and comment out the patch calls. (you need permissions for the repo, just ask me)
  • go back to the main folder and run vagrant up to start up our virtual Machine and than vagrant ssh to enter it. and change to /vagrant/django-gae2django/examples/rietveld
  • run sudo apt-get update && sudo apt-get install python-django make mercurial
  • run make all && follow the instructions
  • run './ runserver' congrants your own rietveld with my changes is running open your browser with the 'localhost:3030'

### Export Data of the existing rietveld
create a folder called export and cd in it. Just start the ruby ../fetch_issue.rb skript, it will end with ../fetch_issues.rb:35:in <main>': undefined method click' for nil:NilClass (NoMethodError) this will be fixed in a future version.

### Import the Data in the created rietveld instance
First of all you need to copy the (should be at django-gae2django/examples/rietveld/ it's a symlink, don't copy that) in the same place upload_issues.rb, and you should change the server name if it's something other than localhost:3030, all you need to do than is call the skript out of the folder were your backup is saved.

comment:11 Changed on 08/12/2014 at 01:10:27 PM by trev

  • Blocking 1194 added

comment:12 Changed on 11/06/2014 at 06:11:39 PM by matze

  • Cc trev added
  • Owner changed from christian to matze
  • Platform set to Unknown
  • Review URL(s) modified (diff)

This ticket is in progress since spring this year (although it was never marked as "Ready"), hasn't seen an update in months, seems to have a LGTM in codereview (wasn't linked before, now it is) and has been pushed already (406:959c15eec9b3).

I assume one just forgot to close the ticket - or do I miss something here?

PS: Since Christian is not here any more and because I cannot "un-assign" a ticket, I've assigned this ticket to me, for now.

comment:13 Changed on 11/06/2014 at 07:00:14 PM by trev

The main part here was never setting up Rietveld, importing the existing data is - and that one is still "in progress" unfortunately.

comment:14 Changed on 11/07/2014 at 08:30:36 AM by philll

We really should ensure our isues being precise and complete before anybody starts working on anything.

comment:15 Changed on 11/07/2014 at 09:20:39 AM by fhd

I've created #1543 for the actual migration. I suggest we change this ticket to only be about setting up a Rietveld server via Puppet. As Matze said, that's already reviewed and pushed, so the issue can be closed.

comment:16 Changed on 11/11/2014 at 10:28:34 PM by trev

  • Blocking 1194 removed

comment:17 Changed on 03/20/2015 at 02:27:34 AM by matze

  • Blocking 2182 added
  • Resolution set to incomplete
  • Status changed from new to closed

I've created #2182 as a meta-ticket for any further action, covering #51 and #1543 as well.

comment:18 Changed on 03/20/2015 at 08:01:10 AM by fhd

  • Resolution incomplete deleted
  • Status changed from closed to reopened

Can be closed as fixed actually - this has landed back then.

Last edited on 03/20/2015 at 08:01:39 AM by fhd

comment:19 Changed on 03/20/2015 at 08:01:25 AM by fhd

  • Resolution set to fixed
  • Status changed from reopened to closed

Add Comment

Modify Ticket

Change Properties
as closed .
The resolution will be deleted. Next status will be 'reopened'.
to The owner will be changed from matze.
Note: See TracTickets for help on using tickets.