[1fanwang]

Tracking issue

Related to flyteorg/flyte#6393.

Why are the changes needed?

A local workflow can fail on its second run after a consumer renames a cached output file. The cache returns the old path, and input conversion raises TypeTransformerFailedError before the consumer runs.

What changes were proposed in this pull request?

Treat missing local artifact references as cache misses so the producer runs again. Valid cached results and remote references keep their existing behavior. Other filesystem errors still propagate.

This does not isolate in-place edits or inspect paths embedded in opaque serialized values.

How was this patch tested?

The same workflow and SQLite cache produced these results:

Checkout	Result
Upstream, first run	The producer ran and the consumer renamed its file.
Upstream, second run	Input conversion failed before the consumer ran.
Patched, same cache	The producer ran again and the workflow completed.

Setup process

E2E

I used Python 3.12.9 with the Flytekit development environment. Save this as repro_6393.py in both checkouts:

Reproducer source: repro_6393.py

import os
import tempfile
from flytekit import Cache, FlyteFile, task, workflow

@task(cache=Cache(version="cache-artifact-probe-1"))
def create_file() -> FlyteFile:
    with tempfile.NamedTemporaryFile(mode="wb", delete=False, dir=os.environ["HOME"]) as file:
        file.write(b"Hello, world!")
        print("PRODUCER_EXECUTED")
        return FlyteFile(path=file.name)

@task
def process_file(file: FlyteFile) -> None:
    path = file.download()
    with open(path, "rb") as source:
        assert source.read() == b"Hello, world!"
    os.rename(src=path, dst=path + ".processed")
    print("CONSUMER_RENAMED_FILE")

@workflow
def wf() -> None:
    process_file(file=create_file())

Keep the same HOME across all three runs:

export HOME="$(mktemp -d /tmp/flyte-cache-XXXXXX)"
export PYTHONPATH=.
export FLYTE_SDK_LOGGING_LEVEL=30
pyflyte run repro_6393.py wf > result.log 2>&1
rc=$?
grep -A 1 -E '^(PRODUCER_EXECUTED|CONSUMER_RENAMED_FILE|TypeTransformerFailedError)' result.log
printf 'exit_code=%s\n' "$rc"

Run twice on upstream, then once on the patched checkout without clearing the cache.

Upstream, first run:

PRODUCER_EXECUTED
CONSUMER_RENAMED_FILE
exit_code=0

Upstream, second run:

TypeTransformerFailedError: Error encountered while converting inputs of
'repro_6393.process_file':
exit_code=1

Patched, same cache:

PRODUCER_EXECUTED
CONSUMER_RENAMED_FILE
exit_code=0

Screenshots

Not applicable.

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

None.

Docs link

The cache lookup docstring describes the missing-artifact behavior.

[codecov]

Codecov Report

❌ Patch coverage is 17.14286% with 29 lines in your changes missing coverage. Please review.
✅ Project coverage is 47.72%. Comparing base (d0c64d5) to head (bd3bc4d).

Files with missing lines	Patch %	Lines
flytekit/core/local_cache.py	17.14%	29 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #3469      +/-   ##
==========================================
+ Coverage   46.34%   47.72%   +1.37%     
==========================================
  Files         327      217     -110     
  Lines       28868    23000    -5868     
  Branches     3039     3049      +10     
==========================================
- Hits        13379    10976    -2403     
+ Misses      15388    11415    -3973     
- Partials      101      609     +508     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.