You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _posts/2016-04-27-failure_and_success.md
+2-3Lines changed: 2 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,8 +6,7 @@ date: 2016-04-27 20:00
6
6
categories: writing
7
7
---
8
8
9
-
Came across [this](http://www.nature.com/naturejobs/2010/101118/pdf/nj7322-467a.pdf) today, a discussion
10
-
of the role of failure as a scientist.
9
+
Recently came across a discussion of the important role of failure as a scientist in Nature (link [here](http://www.nature.com/naturejobs/2010/101118/pdf/nj7322-467a.pdf) seems broken though).
11
10
12
11
This isn't the only example of failure being labelled requisite for success. For instance, MJ in his famous Nike commercial:
13
12
@@ -17,7 +16,7 @@ And later:
17
16
18
17
>I can accept failure, everyone fails at something. But I can't accept not trying.
19
18
20
-
Then there's Thomas J. Watson (IBM):
19
+
Then there's Thomas J. Watson (CEO of IBM in early 20th century):
21
20
22
21
>Would you like me to give you a formula for success? It's quite simple, really: double your rate of failure.
Copy file name to clipboardExpand all lines: _posts/2018-01-14-generalizing_biology.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ date: 2018-01-14 20:00
6
6
categories: writing
7
7
---
8
8
9
-
###Specificity and Biology
9
+
## Specificity and Biology
10
10
11
11
Generality has never been medicine or biology's forte.
12
12
@@ -20,7 +20,7 @@ Similarly, it seems physicians have always been more concerned with the specific
20
20
specific techniques for specific cases. Studying "interesting" patients, diseases or disorders.
21
21
Finding rare genetic mutations.
22
22
23
-
###Generality and Physics/ Math
23
+
## Generality and Physics/ Math
24
24
25
25
On the other hand, the harder, more formal sciences---math, physics, computer science, statistics---seem
26
26
to do the opposite. The more general your contribution, the more widely respected. The more general,
@@ -33,7 +33,7 @@ generalizability is actually proportional to utility. By definition, the more ge
33
33
greater the number of specific facts it applies to. And it's reasonable that the more
34
34
specific facts a statement applies to, the more useful.<supid="a1">[1](#f1)</sup>
35
35
36
-
###Biology vs Physics/ Math
36
+
## Biology vs Physics/ Math
37
37
38
38
But why this difference between the "hard" sciences and biology?
39
39
@@ -44,7 +44,7 @@ though.
44
44
45
45
The most obvious example is the discovery of the central dogma: DNA \\(\Rightarrow\\) RNA \\(\Rightarrow\\) Protein. The exact reason this was exciting was because it applied (i.e. generalized) to **all organisms on the tree of life**. The central dogma is the very basis for biological life.
46
46
47
-
###Towards a Generalized Biology/ Medicine
47
+
## Towards a Generalized Biology/ Medicine
48
48
49
49
So it is in fact possible to achieve generality in biology.
Copy file name to clipboardExpand all lines: _posts/2020-06-01-on_newness.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ date: 2020-06-01 22:25
6
6
categories: writing
7
7
---
8
8
9
-
###No News is Good News
9
+
## No News is Good News
10
10
11
11
Ever hear this quote?
12
12
@@ -20,7 +20,7 @@ This is why you may want to read only older books that are "good" because they'v
20
20
21
21
This is also the reason to **not** follow the news. Much of daily news will be found to be inconsequential, and some of it flat-out wrong. The most critical, important pieces of information will survive and find you through channels you trust.
22
22
23
-
###New Ideas and Technologies
23
+
## New Ideas and Technologies
24
24
25
25
To be fair, good and bad are also blanket terms that aren't very helpful when describing something new, since new things are usually unique and harder to categorize. Some aspects may be good, some may be bad, but all of that is not yet understood.
26
26
@@ -30,7 +30,7 @@ The ultimate test of something new is the market. Whether something new survives
30
30
31
31
Take, for example, the venture capital (VCs) market. 90%+ of startups evenutally fail, so it's extremely hard to pick ones early on that do ultimately win. That's basically proof that new ideas are unlikely to be good ones.
32
32
33
-
###Technology and Progress
33
+
## Technology and Progress
34
34
35
35
Consider that technology hasn’t necessarily made us happier, even though it's made us vastly more productive. For example, farming allowed us to make much more food per capita than ever before; but it's also made us more sedentary, which has had a negative impact on our health.
36
36
@@ -42,7 +42,7 @@ The bottomline is that Slack is **new**. In some ways it's better and then later
42
42
43
43
There are countless other examples where later on we've realized unexpected ways a technology has made us worse: cars and climate change, social media and misinformation, automation and underemployment, etc. (Jury's still out on that last one though.)
44
44
45
-
###Newness and Risk
45
+
## Newness and Risk
46
46
47
47
These facts about technology should inform our view of things that are new in general. New things always have the risk of side effects, which can often be unforeseen.
Copy file name to clipboardExpand all lines: _posts/2021-11-29-agile_product_mgmt.md
+9-9Lines changed: 9 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ date: 2021-11-29 08:00
6
6
categories: writing
7
7
---
8
8
9
-
### Product Objectives
9
+
## Objectives
10
10
11
11
This should be done at the beginning of a product management/ development lifecycle:
12
12
@@ -15,17 +15,17 @@ This should be done at the beginning of a product management/ development lifecy
15
15
- These key results should also be designed such that they complement each other. For example, if there is one key result tracking a quantity (e.g. increasing # of active users) there should be another key result that tracks quality (e.g. decreasing churn rate).
16
16
- These objectives and key results (OKRs for short) should be refined and revisited each quarter. The most important objectives will not change very frequently while the key results should be updated quarterly.
17
17
18
-
This is a great reference for how to write good OKRs [https://www.whatmatters.com/faqs/okr-examples-and-how-to-write-them/](https://www.whatmatters.com/faqs/okr-examples-and-how-to-write-them/).
18
+
This is [a great reference](https://www.whatmatters.com/faqs/okr-examples-and-how-to-write-them/) for how to write good OKRs.
19
19
20
-
### Product Team
20
+
## Team
21
21
22
22
- Composition:
23
23
- Product Manager
24
-
- Design Team: 0-1 Designer (depending on if product has a user interface)
24
+
- Design Team: 0-1 Designer (depending on if product has UX/ UI)
25
25
- Engineering Team: 2-8 Engineers
26
26
- Duration: Ideally a sustained, durable team dedicated to developing a single product throughout its lifecycle.
27
27
28
-
### Product Development Process
28
+
## Development Process
29
29
30
30
- This as a four-step cyclic, iterative process that the whole team participates in. The third step in the cycle is commonly referred to in Scrum methodology as a "sprint"[[1]](https://www.amazon.com/Scrum-Doing-Twice-Work-Half-ebook/dp/B00JI54HCU/), while the first two steps are design-focused and commonly referred to as a "design sprint"[[2]](https://www.amazon.com/Sprint-Solve-Problems-Test-Ideas/dp/1442397683).
31
31
- The first two steps in the process can be done at the same time, on the same rhythm as the third step, however there should be an offset where the design team/ sprint is developing designs for future/ upstream features or user stories and the engineering team/ sprint is focused on implementing those features that have already been designed in prior design sprints. The last step of the process, "validation", should ideally be done continuously and is mostly the responsibility of the PM.[[3]](https://www.amazon.com/Lean-Startup-Entrepreneurs-Continuous-Innovation-ebook/dp/B004J4XGN6/)
@@ -34,13 +34,13 @@ This is a great reference for how to write good OKRs [https://www.whatmatters.co
34
34
- Interact with users/ customers to understand their biggest pain points or most desired features.
35
35
- Decide what product features to prioritize that address those needs/ wants, taking into account the business objectives defined above and what value propositions can be offered.
36
36
- This phase should end with a prioritized list of user stories that can be used to design/ build and test prototypes for usability, business viability, feasibility, etc.
37
-
-_Participants_: PM, designer and at least one engineer
37
+
-_Participants_: PM, designer and at least one engineer (optional)
38
38
39
39
40
40
2.**Design** (Prototype and Test)
41
41
- Take the prioritized list of user stories and produces prototypes to be validated with customers.
42
42
- Based on those results, the most promising user stories should be added and prioritized on the product backlog.
43
-
-_Participants_: PM, designer and at least one engineer
43
+
-_Participants_: PM, designer and at least one engineer (optional)
44
44
45
45
46
46
3.**Development** (Build and Launch/ Deploy)
@@ -53,9 +53,9 @@ This is a great reference for how to write good OKRs [https://www.whatmatters.co
53
53
4.**Validation** (Test)
54
54
- This phase requires the PM to validate that what was built and released to users had a positive impact on the product objectives.
55
55
- This phase will naturally lead back into the discovery phase if a feature didn't have the desired outcome, or if it did and there are now new objectives the team needs to prioritize and focus on accomplishing.
56
-
-_Participants_: PM
56
+
-_Participants_: PM, engineering team (optional)
57
57
58
-
### Product Backlog
58
+
## Backlog
59
59
60
60
*The product backlog is important enough that it warrants its own section*
61
61
- The product backlog is a list, ideally prioritized, of user stories (essentially features) grouped into related sets called epics (essentially high-level user stories that describe a larger component with related features) that define the vision for the end product.
Copy file name to clipboardExpand all lines: _posts/2021-12-14-ml_product_strategy.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ date: 2021-12-14 20:00
6
6
categories: writing
7
7
---
8
8
9
-
###The AI Cold Start Problem
9
+
## The AI Cold Start Problem
10
10
11
11
Here's the scenario. You want to be fancy and build a product that leverages some of the latest and greatest in AI to satisy and delight your (future) users.
12
12
@@ -22,7 +22,7 @@ You realize the Wikipedia article could have articulated the problem in a more g
22
22
23
23
By now you realize you have to build value and start solving your users' problems up front, so you can entice them to your app in return for their data. You realize you'll need to build something like a "marketplace", a "[platform](https://sloanreview.mit.edu/article/the-future-of-platforms/)" or even a regular ol' app.
24
24
25
-
###Apps Before AI
25
+
## Apps Before AI
26
26
27
27
Bottom-line: many might think that AI can be leveraged as a core, and potentially killer, feature for a product that satisfies and delights its users. In others words, `AI -> App`.
Copy file name to clipboardExpand all lines: _posts/2022-04-26-product_analytics_from_scratch.md
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,13 +7,13 @@ categories: writing
7
7
toc: true
8
8
---
9
9
10
-
###Becoming Data-driven
10
+
## Becoming Data-driven
11
11
12
12
Being a data-driven product team is critical to being competitive in the modern digital product marketplace.[[1]](https://towardsdatascience.com/why-organizations-need-to-be-data-driven-98ade3ca53a)[[2]](https://www.pwc.com/us/en/services/consulting/analytics.html) However, many teams tend to overweight the importance of technology adoption, relative to culture and process change, in efforts to become more data-driven.[[3]](https://hbr.org/2022/02/why-becoming-a-data-driven-organization-is-so-hard)
13
13
14
14
Thus, product teams should begin their data-driven transformation by firstly buying into and applying current best practices in digital product analytics. And, then only secondarily, adopting modern data tools that facilitate and accelerate that transformation.
15
15
16
-
###Optimizing the User Journey
16
+
## Optimizing the User Journey
17
17
18
18
The vision for any product is to delight users and make money in the process. There are many ways to measure how well teams and their products are achieving this vision, however, more than likely these measures will be *lagging indicators*, which are downstream measures of success that are difficult to control and not helpful guides for product development.
19
19
@@ -24,7 +24,7 @@ A technique commonly used to develop leading indicators in consumer applications
One popular approach to defining the stage of a user journey is the “AARRR!” framework (also known as the Pirate metrics framework), where each letter in the acronym represents a step in the customer journey: acquisition, activation, retention, referral and revenue.[[4]](https://500hats.typepad.com/500blogs/2007/06/internet-market.html)
30
30
@@ -35,13 +35,13 @@ Using this framework, we now have a clearer, more mechanistic picture of how we
35
35
36
36
From here, the would want to develop and operationalize specific measures at each of these stages, which can then be used to gauge how product changes impact performance at each stage. For this, we lean on another 5-step framework.
37
37
38
-
###Let’s Talk Numbers
38
+
## Let’s Talk Numbers
39
39
40
40
One well-known 5-step process for developing successful metrics is as follows: define, measure, analyze, improve and control. Called DMAIC for short, this is a Six Sigma process improvement method and was adopted by Amazon to develop metrics across their various business units.[[5]](https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595)
41
41
42
42
Importantly, this is an end-to-end process not only for defining and implementing metrics up front but also for continuously refining the definitions and implementations until they successfully aid product improvement, which in this case means they successfully correlate product improvements with leading indicators and leading with lagging indicators.
43
43
44
-
#### Define
44
+
**Define**
45
45
46
46
The purpose of this step is to define how metrics quantify customer behavior at each user journey stage. This step is basically the mock-up design stage of analytics development.
47
47
@@ -55,7 +55,7 @@ The purpose of this step is to define how metrics quantify customer behavior at
55
55
| Referral | Recommender | Refer 1+ user who visits the site | 1%
This step is performed by the data engineering/ product team, where data engineers develop software that accurately and reliably implements these measurements. A recent trend in this space is to leverage technologies now commonly referred to as the “modern data stack”, rather than developing tools in-house.
61
61
@@ -68,7 +68,7 @@ For implementing measurements, MDS tools that could be used are: Snowplow[[7]](h
68
68
69
69
The nice part about using tools like Snowplow is they have built-in functionality for dealing with data quality issues, allowing users to define data schema and validation checks. It automatically saves records that fail these checks so data analysts can go back, analyze and diagnose why these failures might be happening.
70
70
71
-
#### Analyze
71
+
**Analyze**
72
72
73
73
This step is all about deeply understanding all factors that influence a metric implementation. To do this, typically a team will implement a dashboard and data visualization layer so they can observe metrics over time and begin to ask questions about them. The technologies commonly used at this layer are Looker[[10]](https://www.looker.com/) or Mode[[11]](https://mode.com/). An example implementation would look something like this:
74
74
@@ -79,7 +79,7 @@ A common occurrence at this stage is to encounter bugs or issues with the data,
79
79
80
80
Another aspect to this step is to understand how metrics differ over time between different cohorts of users–for example, age and location demographics–which can be very useful for increasing user retention.[[13]](https://heap.io/topics/how-cohort-analysis-improves-retention-reduces-churn)
81
81
82
-
#### Improve
82
+
**Improve**
83
83
84
84
In contrast to the prior step, the purpose of this step is to understand relationships between metrics, rather than examining them in isolation. Specifically, the goal is to understand how leading (or upstream) metrics impact lagging (or downstream) metrics. For example, the data product team might implement a dashboard visualizing both weekly and daily visitors to get a sense whether there is a correlation between the two metrics.
85
85
@@ -93,13 +93,13 @@ When a company and product team get to a certain level of maturity, another impo
In the final step of the DMAIC process, the goal is to demonstrate that the team can control and manipulate specific lagging indicators by changing or experimenting with certain leading metrics. In short, to operationalize product analytics. One interesting part of this step, now possible with MDS tooling, could be to implement so-called “reverse ETL” to export metrics and other data back into upstream product marketing and engagement tools (e.g. MailChimp) for the purposes of increasing user engagement, retention and improving marketing.[[15]](https://hightouch.io/blog/reverse-etl/)
99
99
100
100
Part of this step can also involve adding additional automation to the data system such that data quality and reliability indicators are tracked clearly in dashboards and operationalized into notifications, where applicable.
101
101
102
-
###Conclusion
102
+
## Conclusion
103
103
104
104
To sum up, the highest impact analytics practice product teams can adopt is to map/ define, measure and analyze its users’ journeys. With that, the highest value data product is one that measures and analyzes changes in user journey metrics as they relate to each other, which can ultimately be used to increase retention and revenue. In terms of prioritization, user retention seem most likely to have the highest direct impact on revenue and so should be prioritized for experimentation and control.
Copy file name to clipboardExpand all lines: _posts/2022-08-01-projects_v_products.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -112,7 +112,7 @@ If the primary concern is _value_, think about cyclic iteration working towards
112
112
<br />
113
113
<br />
114
114
115
-
## **Side Note:** Product Development and Evolution
115
+
**_Side Note:_ Product Development and Evolution**
116
116
117
117
Another important aspect about products: there are a lot of similarities between the process of product development and evolution. The space and dynamics of valuable products and businesses–what we call _markets_–closely resemble the competition and dynamics of biological ecosystems.
0 commit comments