Skip to content
forked from kingsimba/nigit

A tool to manage large projects which consists of a group of GIT repositories

License

Notifications You must be signed in to change notification settings

NavInfoNC/nigit

 
 

Repository files navigation

Actions Status

A Tool for Managing a Group of Git Projects

What is it?

It's often helpful to divide a large project into subprojects, with each subproject has its own Git repository.

With nigit, you can manage the correlated projects as a whole, by syncing them together, switching branch together, etc.

The benefits of this approach are:

  • Help cutting clear lines between subprojects. Subprojects can be compiled and tested individually. This will foster stable public APIs and better modularization.
  • Each subproject can have different collaborators and permissions. This is very important in corporations in which different people have different access permissions.

If you are familiar with 'git', you will find it easy to learn.

There is a similar tool https://gerrit.googlesource.com/git-repo made by Google for Android system development.

Installation

Please use npm package manager to install it:

npm install nigit -g

Prerequisites

For it to work, the main project must contain a 'nigit.json' file. It lists its subprojects.

{
   "projects": [
      {
         "url": "git@github.com:NavInfoNC/json-script.git"
      },
      {
         "url": "git@github.com:kingsimba/express-typescript-mocha-vscode.git"
      },
      {
         "name": "ncgeo",
         "url": "git@github.com:NavInfoNC/nc-geo.git"
      }
   ]
}

name is Optional. If not given, the name will be deduced frm the URL.

Initialization

The clone command will clone/download the main project and then all subprojects.

$ nigit clone git@github.com:kingsimba/nigit.git
=== nigit ===
Cloning into 'nigit'...
remote: Enumerating objects: 99, done.
remote: Counting objects: 100% (99/99), done.
remote: Compressing objects: 100% (64/64), done.
remote: Total 99 (delta 51), reused 76 (delta 31), pack-reused 0
Receiving objects: 100% (99/99), 28.98 KiB | 39.00 KiB/s, done.
Resolving deltas: 100% (51/51), done.
=== json-script ===
cloning git@github.com:NavInfoNC/json-script.git
=== express-typescript-mocha-vscode ===
cloning git@github.com:kingsimba/express-typescript-mocha-vscode.git
=== ncgeo ===
cloning git@github.com:NavInfoNC/nc-geo.git

After cloning, all the projects will be ready, side-by-side.

$ ls
nigit/
json-script/
express-typescript-mocha-vscode/
ncgeo/

List

The list command show the URLs of all projects. The first project is the main project.

$ nigit list
nigit => git@github.com:kingsimba/nigit.git
json-script => git@github.com:NavInfoNC/json-script.git
express-typescript-mocha-vscode => git@github.com:kingsimba/express-typescript-mocha-vscode.git
ncgeo => git@github.com:NavInfoNC/nc-geo.git

Pull

The pull command will make sure all subprojects are properly cloned/download and up-to-date.

  • If a project is missing, it will clone/download it.
  • If a project is a git repository it will run git pull --ff-only.
  • If a project is a zip file, it will check if it's update-to-date and download it if not.
$ nigit pull
=== main_project ===
Already up to date.
=== subproject_A ===
Already up to date.
=== subproject_B ===
error: Failed to clone git@xxxx:xxx/subproject_B.git.
Please make sure you have the correct access rights.
and the repository exists.
=== subproject_C ===
Updating 1fe91ee..5a7820f
Fast-forward
src/roadnet_layer/property_item_generators.cpp | 4 +-
src/routing/vehicle_info_float_view.cpp | 25 +++++------
src/the_app.cpp | 62 ++++++++++++++++----------
3 files changed, 53 insertions(+), 38 deletions(-)

As shown above, if you have no access to a project, it will be skipped.

Status

The command status will show the current state of all projects. Similar with 'git status'.

$ nigit status
Project                          Changes
----------------------------------------
nigit                            + nigit-1.0.5.tgz
                                 M README.md
                                 M src/nigitlib/git_checkout.ts
                                 M src/nigitlib/git_status.ts
                                 ? nigit-1.1.0.tgz
express-typescript-mocha-vscode  M package-lock.json
                                 M package.json
                                 M src/users.spec.ts

Clean

Remove untracked files.

This is very dangerous. Please use '--dry' to preview the results first. And use '--force' to actually remove them.

$ nigit clean --dry
Project                          Message
----------------------------------------
nigit                            Would remove a.cpp

Branch or Tag

Show Branches

$ nigit branch
Project                          Current Branch
-----------------------------------------------
nigit                            master
json-script                      test_branch
express-typescript-mocha-vscode  master
ncgeo                            master
zlib                             (not git repo)

--all : Show all branches.

--features : Show all feature branches(not 'master' or 'branches/xxx').

Switch Branch

Try to checkout all projects to the same branch.

If no such branch exist for a subproject, fallback to a branch which is the same as the main project.

$ nigit checkout data-driver
Project        Branch
---------------------
main_project   master (Cannot find 'data-driver')
subproject_A   data-driver
subproject_B   data-driver
subproject_C   master (Cannot find 'data-driver')
  • 'main_project' has no such branch, so it will remain on master.
  • 'subproject_A' and 'subproject_B' has data-driver branch, so they will switched.
  • 'subproject_C' has no such branch, so it will follow 'main_project'.

--force : Discard all local changes. Checkout to specified branch forcefully.

Create Feature Branch

To implement a feature, sometimes several subprojects will be modified. They should have the same branch name.

$ nigit start another_branch nigit ncgeo
=== nigit ===
Branch 'another_branch' set up to track local branch 'sample_branch'.
=== ncgeo ===
Branch 'another_branch' set up to track local branch 'master'.

Create Release Branch

Only the ones who have access to all the subprojects can create a release branch.

$ nigit start branches/1.0.x
=== nigit ===
Branch 'branches/1.0.x' set up to track local branch 'another_branch'.
=== json-script ===
Branch 'branches/1.0.x' set up to track local branch 'master'.
=== express-typescript-mocha-vscode ===
Branch 'branches/1.0.x' set up to track local branch 'master'.
=== ncgeo ===
Branch 'branches/1.0.x' set up to track local branch 'another_branch'.
=== zlib ===
Not a git repository. skipped.

Create / List Tags

Create a tag for all projects

$ nigit tag -c v1.0.8
Project                          Message
----------------------------------------
nigit                            'v1.0.8' created
json-script                      'v1.0.8' created
express-typescript-mocha-vscode  'v1.0.8' created
ncgeo                            'v1.0.8' created
zlib                             (Not a git repository)

List all tags of the main project. The pattern is optional.

$nigit tag -l "v1.0*"
v1.0.1
v1.0.2
v1.0.3

Using Precompiled Binaries

If someone has no permission to some subprojects. They won't be able to build the project as a whole.

But they can use the pre-compiled binaries. Here is how to set it up.

  1. Let's assume we have a project with the following structure:

      ├── awesome-project
      │   └── nigit.json
      ├── module-a
      │   ├── include
      │   │   └── module-a
      │   │       └── module-a.h
      │   └── src
      │       └── some-src.cpp
      └── module-b
          ├── include
          │   └── module-b
          │       └── module-b.h
          └── src
              └── some-src.cpp

  1. Setup a CI system to continuously build all projects.

The compiled binaries/libraries must be put in a ZIP file. The zip file must contain a single folder which has the same name as the the file itself. For example, awesome-libs.zip should have a single root folder 'awesome-libs/'.

The content of awesome-libs.zip is:


      └── awesome-libs
          ├── include
          │   ├── module-a
          │   │   └── module-a.h     // collected header files
          │   └── module-b
          │       └── module-b.h      // collected header files
          └── lib
              ├── module-a.lib         // pre-compiled libraries
              └── module-b.lib         // pre-compiled libraries

  1. Modify the nigit.json to include the ZIP file
{
   "projects": [
      {
         "url": "git@github.com:someone/module-a.git"
      },
      {
         "url": "git@github.com:someone/module-b.git"
      },
      {
         "url": "https://my-ci-system.com/awesome-libs.zip"
      }
   ]
}

If someone don't have access to module-b, after running 'nigit pull', he will have a working tree like:

   ├── awesome-project
   │   └── nigit.json
   ├── module-a
   │   ├── include
   │   │   └── module-a
   │   │       └── module-a.h
   │   └── src
   │       └── some-src.cpp
   └── awesome-libs
       ├── include
       │   ├── module-a
       │   │   └── module-a.h
       │   └── module-b
       │       └── module-b.h
       └── lib
           ├── module-a.lib
           └── module-b.lib
  1. Modify project settings.

    • Use awesome-libs/include/ before module-a/include and module-b/include.
    • Link to awesome-libs/lib/ before module-a/lib/ and module-b/lib/.

Changelog

  • 1.5.10 @2021-01-06

    Support --skip-main for 'pull' command.

  • 1.5.8 @2020-12-28

    • Use at most 5 concurrent tasks for 'nigit pull'. Because some servers may reject SSH connections with "error: kex_exchange_identification: Connection closed by remote host"
  • 1.5.2 @2020-07-21

    • Bug fix: Make it work under Linux.
  • 1.5.0 @2020-07-21

    • Add 'clean' command.
  • 1.4.0 @2020-07-17

    • Add 'tag' command.
  • 1.3.2 @2020-07-14

    • Fixed bug #2: Field "name" doesn't work properly for .zip project
  • 1.3.0 @2020-07-01

    • Support "nigit start" to create branches.
  • 1.1.0 @2020-06-18

    • Make the output of 'branch' and 'checkout' command more readable.
  • 1.0.1 @2020-04-23

    • Support '--force' in 'nigit checkout'. It will discard local changes.

About

A tool to manage large projects which consists of a group of GIT repositories

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 93.0%
  • JavaScript 7.0%