-
Notifications
You must be signed in to change notification settings - Fork 2
Description
๐ PRs Copilot Support Rotation โ Additional Details
This post is a follow-up to the main discussion post outlining upcoming changes to the FR and oncall rotations across our department. The purpose of this update is to provide specific details and clarify how the new weekly support rotation will work for the PRs Copilot team, now that our teamโs FR and oncall responsibilities are being decoupled from the other teams.
๐ค PRs Copilot Team: Weekly Support Rotation
๐ Rotation Setup
- ๐๏ธ Weekly Support Rotation: Establish a weekly rotation for the PRs Copilot team, covering both First Responder (FR) and Oncall responsibilities.
- ๐ค๐ฅ Primary & Secondary Assignment: Each week, one engineer is assigned as primary and another as secondary.
- ๐ Primary Engineer: Responsible for all FR duties (monitoring PRs, triaging issues, partner support, Slack channel coverage, status updates) and receives all pagers/alerts.
- ๐ Secondary Engineer: Focuses on regular engineering work but is on standby for oncall support.
- ๐ Pager Escalation: If the primary engineer does not acknowledge a pager within the specified time, it is automatically escalated to the secondary engineer.
- ๐ค Collaboration: Primary engineer can proactively request help from the secondary engineer for challenging incidents or high workload.
- โก L3 Escalation: Satish, Justin, Ryan, and Maude will be on L3 escalation.
๐ ๏ธ Products Covered in Rotation
- ๐ CCR (Copilot Code Review)
- ๐ PR Summaries
- ๐ฌ PR Diff Chat
๐จ First Responder Responsibilities
๐๏ธ Issue Management
- Triage new issues from the First Responder dashboard by assessing impact and priority.
- Investigate root causes, resolve, and deploy fixes for high-priority or critical items.
- Route or assign other issues to owners or add to backlog as appropriate.
๐ ๏ธ Incident Repair & Short-Term Resolution
- Create incident repair items and resolve short-term fixes for pagers encountered during the weekly rotation.
๐ PR Triage & Review
- Monitor incoming PRs from partner teams; assign or review based on priority.
๐ฌ Slack Monitoring
- Actively monitor team channels during working hours.
- Be the first point of contact for questions or blockers from partner teams.
Key Slack channels:
#copilot-code-review#copilot-code-review-feedback#ccr-clients#copilot-prs-ops(for CCR Agent service deployment)
๐ข Status Updates
- Share status updates in the team channel as part of async stand-up rhythm.
โ๏ธ Oncall Responsibilities
- ๐จ Incident Response: Respond to alerts and production issues impacting the teamโs service.
- ๐ Mitigation & Escalation: Resolve or escalate issues as needed; ensure follow-up actions are logged.
- ๐ Monitoring Health Checks: Keep dashboards and alerting configurations up to date.
- ๐ Postmortem Support: Contribute to root cause analysis and documentation for major incidents.
- ๐ Availability: Be reachable during oncall shifts as per rotation schedule.
๐ Upleveling Engineer Skills for Support Rotation
To ensure every team member feels confident and empowered in the PRs Copilot weekly support rotation, we are committed to continuous learning and skill development. Hereโs how weโll support upskilling as a team:
- ๐งโ๐ป Shadowing & Pairing: New engineers or those less familiar with support/oncall work can pair with experienced team members during their first rotation(s) or shadow as a secondary before taking on primary responsibilities.
- ๐ Knowledge Base: Weโll maintain and expand our internal docs, runbooks, and incident playbooks covering common support tasks, troubleshooting guides, and escalation procedures.
- ๐ Training Sessions: Regular walkthroughs or Q&A sessions on key systems (e.g., CCR, PR Summaries, PR Diff Chat), alerting dashboards, and incident response protocols.
- ๐ก Internal Demos: Share learnings from recent incidents, support wins, or new tools/processes in team meetings or Slack threads.
- ๐ Ask for Help: Encourage a culture where itโs always OK to ask questions, request context, or flag blockersโespecially during your first few rotations.
If you have suggestions for topics, resources, or would like to lead a session, please let the team know! Our shared goal is to make everyone successful in the new rotation.
๐ Thank You & Looking Ahead
Thank you all for your flexibility and collaboration as we roll out this new rotation model. Change can be challenging, but Iโm confident in our ability to adapt and thrive as a team. Please reach out with feedback, questions, or concerns at any time.
Weโll navigate this together, support one another, and continue to deliver great results as a team! ๐๐ค