HowTo Automate repository creation

Version 2 (Nicolas Chuche, 2007-11-18 20:51)

1 1 Nicolas Chuche
h1. Automating repository creation
2 1 Nicolas Chuche
3 1 Nicolas Chuche
{{>TOC}}
4 1 Nicolas Chuche
5 1 Nicolas Chuche
h2. overview
6 1 Nicolas Chuche
7 2 Nicolas Chuche
As of version 0.5.0, Redmine is able to handle Subversion repository creation. This is done by reposman.rb a script found in extra/svn/. With a recent version of Redmine (0.6.0 or re. 860 and later), reposman.rb can register the new repository in Redmine for you and set the owner of repository to who you want. If you have an older version, you will have to register repositories by yourself.
8 1 Nicolas Chuche
9 1 Nicolas Chuche
Projects are retrieved from Redmine using a SOAP web service. This web service is disabled by default in Redmine.  To enable it, go to « Administration -> Settings » and check *Enable WS for repository management*.
10 1 Nicolas Chuche
11 2 Nicolas Chuche
Before going further, we need to choose some names, I will use @my.redmine.host@ as the redmine hostname and @my.svn.server@ as the svn server... You must create the directory where you want to put all your repositories, the owner must be root. I will use @/var/svn@ :
12 2 Nicolas Chuche
<pre>
13 2 Nicolas Chuche
mkdir /var/svn
14 2 Nicolas Chuche
chmod root:root /var/svn
15 2 Nicolas Chuche
chmod 0750 /var/svn
16 2 Nicolas Chuche
</pre>
17 1 Nicolas Chuche
18 2 Nicolas Chuche
We must also choose the directory apache will use to serve repositories to users, I choose @/svn@, so repository URL will look like http://my.svn.server/svn/PROJECTID/ and a last one, the directory apache will use for Redmine browsing, I will use @/svn-private/@.
19 1 Nicolas Chuche
20 2 Nicolas Chuche
And eventually, you need to know the name of apache user, as it's @www-data@ on debian/ubuntu. I will use this one.
21 2 Nicolas Chuche
22 2 Nicolas Chuche
h2. warnings
23 2 Nicolas Chuche
24 2 Nicolas Chuche
Notice that reposman.rb before re. 916 has a right problem. You don't need to update redmine but just "reposman.rb":http://redmine.rubyforge.org/svn/trunk/extra/svn/reposman.rb
25 2 Nicolas Chuche
26 2 Nicolas Chuche
The Perl reposman version is deprecated for new installation as it can't register and set the owner.
27 2 Nicolas Chuche
28 1 Nicolas Chuche
h2. command line arguments
29 1 Nicolas Chuche
30 1 Nicolas Chuche
It takes 2 mandatory arguments:
31 1 Nicolas Chuche
32 1 Nicolas Chuche
    * @svn-dir@: path to the directory where your svn repositories are located
33 1 Nicolas Chuche
    * @redmine-host@: host name of your Redmine install
34 1 Nicolas Chuche
35 1 Nicolas Chuche
And two optional arguments (added in re. 860):
36 1 Nicolas Chuche
37 2 Nicolas Chuche
    * @owner@: the owner of repositories
38 1 Nicolas Chuche
    * @url@: the base url Redmine will use to access your
39 1 Nicolas Chuche
             repositories. With this option, reposman will register the new
40 1 Nicolas Chuche
             repositories so that you will have nothing to do
41 1 Nicolas Chuche
    
42 2 Nicolas Chuche
The Perl reposman version is deprecated for new installation as it
43 2 Nicolas Chuche
can't register and set the owner.
44 1 Nicolas Chuche
45 1 Nicolas Chuche
h2. question you should answer before going further
46 1 Nicolas Chuche
47 2 Nicolas Chuche
If Redmine and your svn repositories are on the same server, you may use the file:/// protocol of svn to browse them, but even if it seems a good idea, if later you want to move repositories on another server, you will have a problem because you can't change repository path in redmine for now.
48 1 Nicolas Chuche
49 1 Nicolas Chuche
The best way I can think of now is to do as if repositories and redmine are already on two different servers and using network subversion to allow Redmine browsing.
50 1 Nicolas Chuche
51 2 Nicolas Chuche
If you want to use local browsing (the file:/// protocol), use @--url file:///var/svn/@ instead of.
52 2 Nicolas Chuche
53 1 Nicolas Chuche
h2. automating repository creation to authenticate with apache/webdav and mod_perl
54 1 Nicolas Chuche
55 2 Nicolas Chuche
Before going further, we will check that reposman find the Redmine Web Service. *Do this as an unprivileged user* that can't write in /var/svn :
56 1 Nicolas Chuche
57 1 Nicolas Chuche
<pre>
58 2 Nicolas Chuche
ruby reposman.rb --redmine my.redmine.host --svn-dir /var/svn --owner www-data --url http://my.svn.server/svn-private/ --verbose
59 1 Nicolas Chuche
querying Redmine for projects...
60 1 Nicolas Chuche
retrieved 2 projects
61 1 Nicolas Chuche
treating project myproject
62 1 Nicolas Chuche
svnadmin: Repository creation failed
63 1 Nicolas Chuche
...
64 1 Nicolas Chuche
</pre>
65 1 Nicolas Chuche
66 1 Nicolas Chuche
It's normal the creation failed, you have no right, but the good point is that reposman find the Web Service and projects.
67 1 Nicolas Chuche
68 1 Nicolas Chuche
If this doesn't work, make sure you have check the *Enable WS for repository management* option.
69 1 Nicolas Chuche
70 2 Nicolas Chuche
Now that you know everything is ok, you just need to invoke resposman.rb as root with the right options :
71 1 Nicolas Chuche
72 1 Nicolas Chuche
<pre>
73 2 Nicolas Chuche
  reposman.rb --redmine my.redmine.host --svn-dir /var/svn --owner www-data --url http://svn.server/svn-private/
74 2 Nicolas Chuche
</pre>
75 2 Nicolas Chuche
76 2 Nicolas Chuche
Be careful with the @--url@ option, you can't change it if you change your thought after.
77 2 Nicolas Chuche
78 2 Nicolas Chuche
You can now add this line in your crontab :
79 2 Nicolas Chuche
80 2 Nicolas Chuche
<pre>
81 1 Nicolas Chuche
cat /etc/cron.d/redmine
82 2 Nicolas Chuche
10 * * * * root ruby reposman.rb --redmine my.redmine.host --svn-dir /var/svn --owner www-data --url http://my.svn.server/svn-private/ >> /var/log/reposman.log
83 1 Nicolas Chuche
</pre>
84 2 Nicolas Chuche
85 2 Nicolas Chuche
It's allmost done for this part.
86 1 Nicolas Chuche
87 1 Nicolas Chuche
h2. Web Service and Security
88 1 Nicolas Chuche
89 1 Nicolas Chuche
For the moment, the WS is open to everybody once actived and you surely don't want that someone register repository's project for you. You can block access to the WS with apache (if you don't use apache, I let you do your homework...) with the Location apache directive like this :
90 1 Nicolas Chuche
91 1 Nicolas Chuche
<pre>
92 1 Nicolas Chuche
   <Location /sys>
93 1 Nicolas Chuche
      Order allow,deny
94 1 Nicolas Chuche
      Allow from ip.of.my.svn.server
95 1 Nicolas Chuche
   </Location>
96 1 Nicolas Chuche
</pre>
97 1 Nicolas Chuche
98 1 Nicolas Chuche
So if you are using apache and mongrel, you will have something like that :
99 1 Nicolas Chuche
100 1 Nicolas Chuche
<pre>
101 1 Nicolas Chuche
<VirtualHost *:80>
102 1 Nicolas Chuche
   ServerName redmine.my.domain
103 1 Nicolas Chuche
   ServerAdmin webmaster@localhost
104 1 Nicolas Chuche
105 1 Nicolas Chuche
   <Location /sys>
106 1 Nicolas Chuche
      Order allow,deny
107 1 Nicolas Chuche
      Allow from ip.of.my.svn.server
108 1 Nicolas Chuche
   </Location>
109 1 Nicolas Chuche
110 1 Nicolas Chuche
   ProxyPass / http://localhost:3000/
111 1 Nicolas Chuche
   ProxyPassReverse / http://localhost:3000/
112 1 Nicolas Chuche
</VirtualHost>
113 1 Nicolas Chuche
</pre>