t2

Install

On osx, running JDK 1.8.0

Untar in ~/app and rename to spark and hadoop

spark

hadoop

Create a python3.7+ virtual environment

Clone kgx inside this repo, overwriting exixting kgx directory.

Then restore kgx/kgx/transformer.py with git checkout kgx/kgx/transformer.py

Running

Import some robokop data via kgx

t2 robokop import

In a shell:

t2 spark master start

In another shell

t2 spark worker start

In another shell

t2 spark shell

Then, at the scala prompt:

:load load.scala