Skip to content

README.md

Latest commit

 

History

History
34 lines (26 loc) · 1.23 KB

README.md

File metadata and controls

34 lines (26 loc) · 1.23 KB

Validator

A service for ensuring Data Correctness

Java 8 ☕️

Overview

  • Validator was initially built to ensure Data Correctness in Replicator.
  • Can be used for validating data between any two data sources.

Configuration

  • Sample validator configuration is in config.yaml
  • Config options:
    • data_sources: Currently supports mysql/hbase/bigtable
    • task_supplier: Currently supports kafka
    • reporter: Currently supports graphite
    • discrepancy_sink: Currently supports kafka
    • retry_policy: Specifies delay for retry in case of mismatch. (in milliseconds)
  • Detailed configuration instructions can be found here.

Setup/Run instructions

LOCAL

  • Clone this repository and $ cd validator/
  • $ mvn clean package Builds a JAR from the source
  • $ ./run.sh Runs the validator using validator-conf.yaml

DOCKER

  • TODO

ACKNOWLEDGEMENT

This software was originally developed at Booking.com. With approval from Booking.com, this software was released as open source, for which the authors would like to express their gratitude.