Skip to content

add kubeflow to flyte migration guide#370

Open
fiedlerNr9 wants to merge 158 commits intov1from
jan/add-kubeflow-migration-guide
Open

add kubeflow to flyte migration guide#370
fiedlerNr9 wants to merge 158 commits intov1from
jan/add-kubeflow-migration-guide

Conversation

@fiedlerNr9
Copy link
Contributor

@fiedlerNr9 fiedlerNr9 commented Jun 5, 2025

Add kubeflow migration guide.

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Jun 5, 2025

Deploying docs with  Cloudflare Pages  Cloudflare Pages

Latest commit: a28ec11
Status:🚫  Build failed.

View logs

nelsonjr and others added 24 commits July 29, 2025 10:08
* V2 site

* beta message
* Add flyte 2.0 banner (#401)

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

# Conflicts:
#	themes/union/layouts/partials/header.html

* update banner style (#415)

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* adjust wording

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* change wording again

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* fix link

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* Remove 2.0 info box

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

---------

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
Co-authored-by: Niels Bantilan <niels.bantilan@gmail.com>
Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
* add code agent tutorial (#337)

* update docs

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* revert to main

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix tutorials landing page (#338)

* fix tutorials landing page

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix tutorials landing page

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update title

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update submodule, shorten title

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* shorten title more

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* fix card

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
Co-authored-by: Samhita Alla <aallasamhita@gmail.com>
* Ad link to example repo

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* fix links

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* Adjust presentation

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

---------

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
* Fix config for flyte

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* fix

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* switcheroo

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* clean up

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

* more cleanup

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>

---------

Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
Signed-off-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
* update migration guide code snippets

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* remove reuse policy in flyte variant

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

---------

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
* beta message

* parameterize search

* revert
Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
* Add CTA

* Adjust
* Add versions to docs_home

fix

* add links
* add HPO tutorial

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update ref

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix variant content

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* remove pages for now

* fix image

* fix html comment

* fix comments

* re-order top menu

* expand sidebar for user guide

* condiional rendering for reusable

* compactify table
* add openai integrations

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* add ray and spark top-level pages

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* Update content/integrations/flyte-plugins/openai/_index.md

Co-authored-by: Kevin Su <pingsutw@apache.org>

---------

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: Kevin Su <pingsutw@apache.org>
kumare3 and others added 24 commits December 22, 2025 13:53
…ns intro (#628)

* Unit testing docs

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* updated

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* More updates

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* pod templates docs

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* Container tasks

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* More updates

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* merge pod template content, update page filenames

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

---------

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
Co-authored-by: Niels Bantilan <niels.bantilan@gmail.com>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
* app doc updates

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* update app input -> parameter

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* rename files

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* updates

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* fixed

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* Updated unionai-examples commit

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

---------

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
* Update image builder doc for v2

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comment

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR comment

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

---------

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>
Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
* remove first method for running deployed tasks

* link fix
* Update SDK API docs to b44

* improve sdk docs gen
Change the virtual environment directory from .venv-flyte-api to .venv
for consistency.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Provide context for Claude Code instances working in this repository,
including build commands, variant system architecture, and content guidelines.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
…ough auth (#644)

* Improved docs for Auth

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* Added docs for webhook

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* fixed

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* Updated to b46

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

---------

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
* [wip] b47 should make this true

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* Updated flyte version

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

---------

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
* does this work?

Signed-off-by: Carina Ursu <carina@union.ai>

* ????

Signed-off-by: Carina Ursu <carina@union.ai>

---------

Signed-off-by: Carina Ursu <carina@union.ai>
Co-authored-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
* Interact with runs, get data etc

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>

* Suggested changes

* clarify how runs can be created

* fix code block rendering

---------

Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
Co-authored-by: Peeter Piegaze <1153481+ppiegaze@users.noreply.github.com>
- Add --quiet/-q flag to process_shortcodes.py to suppress progress messages
- Add --quiet/-q flag to build_llm_docs.py to suppress progress messages
- Update Makefile to pass --quiet by default during make dist
- Warnings and errors are still displayed for debugging

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
* Persist full link issues list to file

Write the complete list of broken links to link-issues.txt in the
output directory. Overwrites on each build. Console output now shows
the file path when issues are found.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Move link checking to llms-full.txt generation

Previously, link checking happened in process_shortcodes.py on the
intermediate markdown files. This caused false positives because
restructure_single_pages() changed file locations without updating
relative links inside them.

Now link resolution failures are tracked during llms-full.txt generation
in build_llm_docs.py, which catches actual issues that affect the final
output quality. The report is written to dist/docs/v2/{variant}/link-issues.txt
alongside llms-full.txt.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Fix anchor generation to preserve underscores

Hugo preserves underscores in heading anchors (e.g., `init_from_config`),
but the title_to_anchor function was stripping them, causing false
resolution failures for links like `#init_from_config`.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Normalize lookup keys to lowercase for case-insensitive matching

macOS filesystem is case-insensitive but Python string matching is not.
Links in subpages used mixed case (Image.md) while actual files are
lowercase (image.md), causing lookup failures.

Normalizing both storage and lookup keys to lowercase fixes this.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Fix anchor generation to match Hugo behavior

Hugo removes special chars like () but preserves spaces which become
individual hyphens. "webhooks / APIs" becomes "webhooks--apis" because
the / is removed but the two surrounding spaces each become hyphens.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Fix broken internal links in documentation

- Fix relative path depth in packaging.md for API reference links
- Fix link targets in configure-apps, build-apps, and tutorials

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
* Convert pydantic admonitions and fix relative links in API docs

- Add handling for !!! abstract admonitions (converts to > [!TIP])
- Convert relative pydantic documentation links (../concepts/*.md)
  to absolute URLs (https://docs.pydantic.dev/latest/...)

This fixes ~40 broken link warnings per variant that were caused by
pydantic's docstrings containing relative links to their own docs.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Improve API doc generation for pydantic inherited methods

- Fix HTML escaping to preserve blockquote syntax (> [!NOTE] etc.)
- Handle leading whitespace in MkDocs admonitions from pydantic docstrings
- Convert reference-style markdown links to inline links:
  - pydantic.* -> docs.pydantic.dev
  - pydantic_core.* -> docs.pydantic.dev
  - object.*, functools.*, inspect.* -> docs.python.org
- Skip admonitions when extracting docstring summaries for method tables
- Add "(inherited from pydantic)" label to Usage Documentation tips
- Log warnings for unhandled reference-style links
- Add summary of skipped modules at end of parsing

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Regenerate Flyte SDK API docs with flyte 2.0.0b48

Generated with improved API doc generator that properly handles
pydantic inherited method documentation.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* change message

* update api docs

* spelling

* update api docs

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
@ppiegaze
Copy link
Collaborator

@fiedlerNr9 Doing some cleanup I found this old PR.
Do you want to address Nelson's points and merge it?

Copy link
Collaborator

@ppiegaze ppiegaze left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fiedlerNr9 DO you want to address the open points?

@ppiegaze ppiegaze changed the base branch from main to v1 January 16, 2026 20:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.