Skip to content

Working draft of the survey itself#15

Open
epec254 wants to merge 7 commits intomasterfrom
survey_goals_and_questions
Open

Working draft of the survey itself#15
epec254 wants to merge 7 commits intomasterfrom
survey_goals_and_questions

Conversation

@epec254
Copy link
Contributor

@epec254 epec254 commented Dec 6, 2022

WIP - not yet ready for feedback

Copy link
Contributor

@dpbrinkm dpbrinkm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is going to be sooooo epic if lots of people fill it out!

* Use as filters to analyze other questions
### Questions
* What is your current job title?
* What bucket does your role fall in?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe we need to put other titles like head of data, CDO, CTO etc. I am wondering if its worth having this or just using the above question about what the persons title is

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about something like this?

Suggested change
* What bucket does your role fall in?
* Which best describes you?
* Executive or C-suite
* Director (leader of leaders)
* Manager of a team
* Individual contributor
* Other (please describe)
* [FOR IC ONLY] What bucket does your role fall in?
* [FOR MGR+] Which of the following roles are on your team?
* Other (please describe)

* Within central services
* Part of a business unit
* other?? how do we make this question relevant to startup & big E?
* Which other roles do you collaborate with on MLOps?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

compliance, secuity, board of directors,

maybe another question could be who do you report to directly. how many direct reports do you have

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Which other roles do you collaborate with on MLOps?
* Which other roles do you collaborate with on MLOps?
* Other (please describe)
* Compliance
* Security
* Business stakeholders (executives/directors)
* Business stakeholders (managers)

* What we want to learn
* Outcomes we hope to achieve by learning
* List of questions to be asked

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we ask as the first question something like, are you part of the MLOps community? yes/no

how do you engage with the community

  • Slack
  • podcast
  • blog
  • newsletter
  • IRL meetups
  • virtual events

and make it so you can choose more than one. the reason for this is if many people fill out the survey that arent in the community it may give us a biased view of who is actually in the community

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also asking these 3 questions would be really nice to know because we can learn what kind of stuff people are looking for when joining the community

What are the top 3 priorities for your business / the company you work at
What are your top 3 personal priorities at work
What can this community do to help you / your biz achieve those goals

* transformer model
* graph type of model
* Approach to releasing models and features (CI/CD, manual releases, etc)
* Who is the end user of the prediction(s)?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we also ask something like who would you consider client? data scientist, or end user. or maybe that's already clear from the above?

@gilad-shaham
Copy link

I think it would be good to know what people are looking for based on the category list in AIIA (https://ai-infrastructure.org/ai-infrastructure-landscape/)

Here are the categories:

  • IT Infrastructure
  • Data Labelling
  • Synthetic Data
  • Data Versioning & Management
  • Exploratory Data Analysis (EDA)
  • Feature Stores
  • Code Management
  • Model Development
  • Distributed Training
  • Hyperparameter Tuning
  • Experiment Tracking & Metadata Store
  • Model Repository
  • Model Inference
  • Model Deployment
  • Model Testing / Validation
  • Monitoring / Observability
  • Interpretation / Explainability
  • Team Management
  • Orchestration / Pipelines
  • Machine Learning Security
  • Dashboards
  • AutoML

Another thing that is missing is what they are looking for in MLOps:

  • Build their own
  • Open source
  • commercial
    (could be a combination of the above)

This way it would be possible to find clusters of people with common interest so they can share their challenges + direct them to things like open-source tools that can help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants