List view
https://docs.google.com/document/d/1YagQi0-jSdm9IyiKzPpJjdvyEVHJXOf8fSqOe8owVJc/edit?pli=1#heading=h.j2x04syjuavh
Due by October 27, 2020https://docs.google.com/document/d/1YagQi0-jSdm9IyiKzPpJjdvyEVHJXOf8fSqOe8owVJc/edit#heading=h.ttvyzei07qvh
Due by October 13, 2020https://docs.google.com/document/d/1ATqaWAEXzTLy-Q0Dn_7vcqPtDSq_V7ShXBC2oV6Pzvc/edit?pli=1#heading=h.p4shgfaq92cl
Due by September 29, 2020https://docs.google.com/document/d/1ATqaWAEXzTLy-Q0Dn_7vcqPtDSq_V7ShXBC2oV6Pzvc/edit?pli=1#heading=h.1udlgca5unai
Due by September 8, 2020https://docs.google.com/document/d/1ATqaWAEXzTLy-Q0Dn_7vcqPtDSq_V7ShXBC2oV6Pzvc/edit?pli=1#heading=h.8w1wlrxvopku
Due by August 25, 2020https://docs.google.com/document/d/1ATqaWAEXzTLy-Q0Dn_7vcqPtDSq_V7ShXBC2oV6Pzvc/edit?pli=1#heading=h.9f5wyhissdmv
Due by August 11, 2020https://docs.google.com/document/d/1ATqaWAEXzTLy-Q0Dn_7vcqPtDSq_V7ShXBC2oV6Pzvc/edit#heading=h.qa109wd7qaat
Due by July 28, 2020https://docs.google.com/document/d/1edUpkWA2HY7J9UnQre-H8rBxumDVtgAIRmJCl48Xab8/edit#heading=h.hsrscgb7kcff
Due by July 14, 2020https://docs.google.com/document/d/1edUpkWA2HY7J9UnQre-H8rBxumDVtgAIRmJCl48Xab8/edit?pli=1#heading=h.17c3aqg5t25z
Due by June 30, 2020https://docs.google.com/document/d/1edUpkWA2HY7J9UnQre-H8rBxumDVtgAIRmJCl48Xab8/edit#heading=h.tuplh03z54g9
Due by June 10, 2020https://docs.google.com/document/d/1edUpkWA2HY7J9UnQre-H8rBxumDVtgAIRmJCl48Xab8/edit#heading=h.s0pu4csaboqs
Due by May 26, 2020https://docs.google.com/document/d/1edUpkWA2HY7J9UnQre-H8rBxumDVtgAIRmJCl48Xab8/edit#heading=h.djhqtan5goh5
Due by May 12, 2020https://docs.google.com/document/d/1wvUaHBDGyJN8m9Fh3iqK7U1kMjIMARhVe_gup6QpVIE/edit?pli=1#heading=h.jq1pcsbb4vj4
Due by April 28, 2020https://docs.google.com/document/d/1wvUaHBDGyJN8m9Fh3iqK7U1kMjIMARhVe_gup6QpVIE/edit?pli=1#heading=h.gis7eqfib20z
Due by April 14, 2020https://docs.google.com/document/d/1wvUaHBDGyJN8m9Fh3iqK7U1kMjIMARhVe_gup6QpVIE/edit?pli=1#heading=h.nkpcdwkxfbjt
Due by March 31, 2020https://docs.google.com/document/d/1wvUaHBDGyJN8m9Fh3iqK7U1kMjIMARhVe_gup6QpVIE/edit?pli=1#heading=h.i06i9fxhbclu
Due by March 17, 2020https://docs.google.com/document/d/1wvUaHBDGyJN8m9Fh3iqK7U1kMjIMARhVe_gup6QpVIE/edit?pli=1#heading=h.wml7usug7sjy
Due by February 4, 2020https://docs.google.com/document/d/1wvUaHBDGyJN8m9Fh3iqK7U1kMjIMARhVe_gup6QpVIE/edit#heading=h.fgszy0xtcmy6
Due by January 21, 2020https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.rs6xz4uxm5h0
Due by January 7, 2020https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.5y6wz7q7p0oz
Due by December 17, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.vdggc24xwqc1
Due by November 19, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.h1494254aepk
Due by November 5, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.j9t0g8yhm6bd
Due by October 22, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.vw77pgl3eecs
Due by October 8, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.sedn0ylc16oo
Due by October 1, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.5cdyiwtluzk1
Due by September 10, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.c5dkpws2fai5
Due by September 24, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.ug8s84uv51n0
Due by September 10, 2019- Due by August 27, 2019
https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit?pli=1#heading=h.w6c9d94epq06
Due by August 27, 2019- Due by August 13, 2019
https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.oz4cgebzpp43
Due by July 30, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.3y2adex74ed
Due by July 30, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.u11j3pwughvl
Due by July 16, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.s4m7jwkcg42s
Due by July 2, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.6edabmug1e9w
Due by June 25, 2019•5/5 issues closedhttps://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.2asdnorydgeo
Due by June 11, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.sfmnda2q66qx
Due by June 25, 2019- Due by May 28, 2019
https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.4qdlfw6v3im4
Due by May 28, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.z99ikr7kcf6a
Due by May 14, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.dxivo81wbc9j
Due by May 14, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.21mtxocffmq6
Due by April 30, 2019https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.d0i8p44kx4hd
Due by April 23, 2019see roadmap: https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.uuwep4g6ccoa DeepHash [Heikki, Tom] – paper is submitted - next: more experiments needed, tuning, prep for final version of paper. Model-in-loop – [Marcel] Initial models done, task confidence (uncertainty) estimations next Neckline type model (blocked on client go ahead and job load) Do cats & dogs model Anti-bot motion models Adding more data. Not yet ready for integration, but should arrange meeting. Confidence [Ville] multi-label simulator is implemented, some refinement needed: analysis of existing runs (ROC/confusion matrix); probabilistic task selection; conditioning on client confidence A/B live testing IOU bounding box work [Todd] - **check status** Text detection/recognition [Mohamed] - review presentation prep in progress. Get data from Todd New labeling jobs for new datasets - write up ideas, e.g. face attributes, semantic similarity [Tom]; check with Evin on loading?
Due by April 9, 2019High level goals of this sprint, here: https://docs.google.com/document/d/1MTQ3zMTgIrGD1-iA8ppmy8boI2IiGOrV6PG5fFRQWo8/edit#heading=h.4ix2yjpzm28u
Due by April 9, 2019DeepHash – paper Model-in-loop – [Marcel/ Ville] - look at confidence prediction on sleeve length; - full retuning, - Loss function incorporating label prediction as well as confidence. - Sleeve type model - Anti-bot motion models - Investigate time series analysis models [Marcel, Amir] Confidence: - Add multi-label tasks in simulator [Ville] - Confidence based ML label injection - predict transfer function (ML model confidence -> num injected repeats) [Ville] - Live live A/B Confidence testing: Idea for Shadow Rec Oracle now replaced with new proposal to A/B test at job level from experimental chunk list [Alex/Evin/Ville?] - Batch selection drain attack discussion ticket
Due by March 26, 2019- Redis Refactor [Ian / Alex / Ali / Evin] - Follow up on next steps per discussion last week - Event based customer outreach / email marketing - Task 1 [Jan] - Task 2 + 3 w/ tattler [Alex] - Hcaptcha.com [Arto / Eli] - Design, implement, test on webflow - Largely done - How do we get analytics data: webflow dump? Or GA eventer on our end - Dashboard v2 [Jan / Robert / Arto / Eli / Brad] - Discuss / plan mostly (dependent on hcaptcha.com redesign) - largely done - Frontend react repo beginnings - use js client api and copied json endpoints - Jan - Get json endpoints in place, working with frontend parts - Complete blockchain payouts [Robert / Evin] - Complete all testnet tasks - Loader updates: [Evin / Ali] - Load from blockchain - Groundtruth to all chunks - Testing - Job loads: DRL, ONHOLD: Omni 1x Big, Neckline [Evin / Ali] - Privacy pass [drazen] (also give Drazen some OSS stuff) - light to braze - PR - OSS hcaptcha-v1 [Brad] - Breakout challenges + challenge readmes and cleanup - V2 challenge work: adding feedback, adding “hcaptcha for charity” logo (needs ticket) - Notebooking of offline anti-bot motion models stuff [Amir / Alex / Marcel] **Needs ticket - Paypal payouts (Mar 15) [Robert, Eli] - Update emails in support tickets - Make, test and run payout script [Robert]
Due by March 26, 2019- DeepHash [Heikki] - Imagenet, CelebA reconstruction performance [Heikki] - Compare reconstruction/clustering performance with autoencoder papers [Heikki] - TenCent - hierarchical hashing performance [Heikki] - Start to draft outline for paper [Heikki/Tom] - Chat with Mike Snow about optimal transport implementation [Heikki/Tom] - Chat with Nico on research ideas [Heikki/Tom] - Look at / compare / think about clustering performance [Heikki/Tom] - Model-in-loop - [Ville] to start training Omni classifiers, preloading predictions - Confidence assessment on: - bbox / landmark / polygon [Ville/Todd] - multi choice multi select [Ville/Todd] - Confidence: - Implement & test new metrics (mean responses/tasks done, bot detect rate) [Ville] - New batch selection in simulator + hyperparmeter search [Ville] - Model and figure out strategy to prevent “drain” attacks [Ville] - Integrate GT/ML confidence into batch selection [Ville] - Start to plan how to integrate Amir’s work into confidence calc [Ville/Amir/Tom] - Plan live A/B test system [Ville/Todd/Tom] - Kodak dataset / model - draft plan by Thurs 28 [Tom] - Plan new Faces attribute dataset collection/annotation [Tom]
Due by March 12, 2019- Redis Refactor [Ian / Alex / Ali] - Likely needs a regroup and sync up to discuss where we’re at and addition of some new relevant/actionable tickets - Get chunk refactor into production and working properly - Event based customer outreach / email marketing - Task 2 + 3 w/ Taddler [Alex] - Hcaptcha.com [Arto / Eli] - Design, implement, test on webflow - Dashboard v2 [Jan / Robert / Arto / Eli / Brad] - Discuss / plan mostly (dependent on hcaptcha.com redesign) - Create JS api client for existing json endpoints for dashboard functionality and future use [Jan] - Any new endpoints that need to produce json content vs html content should be put into tickets - Complete blockchain payouts [Robert / Evin] - Complete all testnet tasks - Realtime payouts in testnet (stretch goal) - Load testing framework / tool [Jan / Ian] - Load testing - DDoS testing (via WW?) (stretch) - Cloudflare WW in yellow (stretch goal) - Webhook for client conf changes [Ali / Alex] - Complete new challenges: landmark / bounding / polygon [Brad / Ville / Evin] - Loader updates: [Evin / Ali] - Dogs / cats & replace JRP - Load from blockchain - Testing - Job loads: DRL, Omni 1x Big [Evin / Ali] - OSS hcaptcha-v1 [Brad] - Notebooking of offline anti-bot motion models stuff [Amir] - Discussions: - Feedback form in captcha - Build image refactoring
Due by March 12, 2019