LOCKSS Downloader

The LOCKSS Downloader is a script to download GitHub projects without Git, with Curl, Wget or HTTPie instead.

Invoke the LOCKSS Downloader, either On the Fly or From a Local Copy, with a GitHub Project Reference (Options if needed), and the project will be downloaded from GitHub (by default into a directory in your home directory).

If no GitHub Project Reference is specified, the LOCKSS Downloader downloads the LOCKSS Installer, which is used to install and run the LOCKSS 2.x system.

Latest release: 1.4.0 (2023-04-18)

Table of Contents

• Prerequisites
• Usage
  • On the Fly
  • From a Local Copy
• Synopsis
• Options
  • GitHub Project Reference
  • Git Tree Options
  • Directory Options
  • Fetch Options
  • Other Options
• Advanced

Prerequisites

• One of:
  • Curl (curl)
  • Wget (wget)
  • HTTPie (http)
• One of:
  • tar
  • gtar (MacOS only)

Usage

On the Fly

In this mode of invocation, the LOCKSS Downloader script is fetched (with Curl, Wget or HTTPie), then immediately executed by the shell (with a GitHub Project Reference, and Options if needed), without being stored on the host system:

fetch_the_source_code | sh -s - [OPTIONS...] [PROJECT]

To invoke the LOCKSS Downloader in this mode, fetch https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader, and pipe the result into sh -s -, optionally followed by Options, optionally followed by a GitHub Project Reference (by default the LOCKSS Installer):

# With Curl:
curl -sSfL https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader | sh -s - [OPTIONS...] [PROJECT]
# With Wget:
wget -qO- https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader | sh -s - [OPTIONS...] [PROJECT]
# With HTTPie:
http -qd https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader | sh -s - [OPTIONS...] [PROJECT]

From a Local Copy

In this mode of invocation, you first download the LOCKSS Downloader script to the host system, then inspect it to your satisfaction, then run it yourself (with a GitHub Project Reference, and Options if needed).

To invoke the LOCKSS Downloader in this mode:

1. Fetch https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader:

   # With Curl:
   curl -Lo lockss-downloader https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader
   # With Wget:
   wget -qO lockss-downloader https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader
   # With HTTPie
   http -qdo lockss-downloader https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader
   

   This will create the file lockss-downloader in the current directory.

2. Inspect lockss-downloader to your satisfaction.

3. Run chmod +x lockss-downloader to make lockss-downloader executable.

4. Run ./lockss-downloader, optionally followed by Options, optionally followed by a GitHub Project Reference (by default the LOCKSS Installer):

   ./lockss-downloader [OPTIONS...] [PROJECT]
   

Synopsis

You can see a detailed help message by invoking the LOCKSS Downloader (On the Fly or From a Local Copy) with the --help/-help/-h option:

Usage:

  lockss-downloader [--curl|--httpie|--wget] [--download-dir=DIR] [--git-branch=BRA|
        --git-commit=COM|--git-tag=TAG] [--quiet] [PROJECT]
  lockss-downloader --version
  lockss-downloader --help

Argument:

  PROJECT
        GitHub project reference (default: https://github.com/lockss/lockss-installer;
        format: https://github.com/X/Y or https://github.com/X/Y.git or
        git@github.com:X/Y or git@github.com:X/Y.git or X/Y where GitHub is
        implied)

Options:

  --help, -help, -h
        display this message and exit
  --quiet, -quiet, -q
        produce no output unless an error occurs
  --version, -version
        display this program's version number and exit

Git Tree Options:

  --git-branch=BRA, --git-branch BRA, -git-branch BRA, -b BRA
        use Git branch BRA (default: master)
  --git-commit=COM, --git-commit COM, -git-commit COM, -c COM
        use Git commit COM instead of a Git branch
  --git-tag=TAG, --git-tag TAG, -git-tag TAG, -t TAG
        use Git tag TAG instead of a Git branch

Directory Options:

  --download-dir=DIR, --download-dir DIR, -download-dir DIR, -d DIR
        download into DIR (default: $HOME/$Y where Y is derived from the
        GitHub project reference https://github.com/X/Y)

Fetch Options:

  --curl, -curl, -C
        force the use of Curl
  --httpie, -httpie, -H
        force the use of HTTPie
  --wget, -wget, -W
        force the use of Wget

Options

GitHub Project Reference

If no GitHub Project Reference is specified, the LOCKSS Downloader downloads the LOCKSS Installer, which is used to install and run the LOCKSS 2.x system.

Otherwise, the given GitHub project is downloaded, as specified in one of the following formats:

• https://github.com/foo/bar
• https://github.com/foo/bar.git
• git@github.com:foo/bar
• git@github.com:foo/bar.git
• foo/bar (with GitHub implied, corresponding to https://github.com/foo/bar)

Git Tree Options

By default, the LOCKSS Downloader downloads the head of the master branch of the project being downloaded, but you can change the target with options:

• Use the --git-branch/-git-branch/-b option to reference the head of a given branch (for example main or develop).
• Use the --git-tag/-git-tag/-t or --git-commit/-git-commit/-c options to reference the project as of a given tag (for example version-3.2.0 or hotfix-3.2.1) or commit (for example 0a6c7cef5f426dbe7d4d6ab6d56a2414a6bff746), respectively.

Directory Options

By default, the LOCKSS Downloader downloads the target project https://github.com/X/Y into ${HOME}/<Y>, that is, a directory in the user's home directory whose name is derived from the Git repository name <Y>. To specify your own destination directory, use the --download-dir/-download-dir/-d option.

Fetch Options

By default, the LOCKSS Downloader detects one of Curl (curl), Wget (wget) or HTTPie (http) on the host system to perform the download, in this order, but you can force the choice with the --curl/-curl/-C, --wget/-wget/-W or --httpie/-httpie/-H options, respectively.

Other Options

• The --quiet/-quiet/-q option suppresses the summary displayed at the end of a successful download.
• The --version/-version option displays the version number of the LOCKSS Downloader, then exits.

Advanced

The URL https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader corresponds to the latest stable version of the LOCKSS Downloader, on the main branch of the lockss-downloader Git repository

Tip

As a convenience, the shorter URL https://lockss.org/downlaoder redirects to https://github.com/lockss/lockss-downloader/raw/main/lockss-downloader.

You can use a different version of the LOCKSS Downloader by modifying the URL:

• For a given branch of the lockss-downloader Git repository, use https://github.com/lockss/lockss-downloader/raw/<branch>/lockss-downloader, for example https://github.com/lockss/lockss-downloader/raw/develop/lockss-downloader for the develop branch. See https://github.com/lockss/lockss-downloader/branches.
• For a given tag of the lockss-downloader Git repository, use https://github.com/lockss/lockss-downloader/raw/<tag>/lockss-downloader, for example https://github.com/lockss/lockss-downloader/raw/version-1.2.0/lockss-downloader for the tag version-1.2.0. See https://github.com/lockss/lockss-downloader/tags.
• For a given commit of the lockss-downloader Git repository, use https://github.com/lockss/lockss-downloader/raw/<commit>/lockss-downloader, for example https://github.com/lockss/lockss-downloader/raw/0a6c7cef5f426dbe7d4d6ab6d56a2414a6bff746/lockss-downloader for commit 0a6c7cef5f426dbe7d4d6ab6d56a2414a6bff746. See https://github.com/lockss/lockss-downloader/commits.