Skip to content

Qualcomm AI Engine Direct - HF LLM lm_eval lazy import#20413

Merged
psiddh merged 1 commit into
pytorch:mainfrom
CodeLinaro:dev1/winskuo/hf_llm_lazy_import
Jun 22, 2026
Merged

Qualcomm AI Engine Direct - HF LLM lm_eval lazy import#20413
psiddh merged 1 commit into
pytorch:mainfrom
CodeLinaro:dev1/winskuo/hf_llm_lazy_import

Conversation

@winskuo-quic

@winskuo-quic winskuo-quic commented Jun 22, 2026

Copy link
Copy Markdown
Collaborator

Summary

When importing HF LLM lowering flow from QNN, Optimum-ExecuTorch will run into lm_eval import error. To resolve this issue, we need to make lm_eval lazily imported, meaning we only import when we actually use the library.

Test plan

NA

@pytorch-bot

pytorch-bot Bot commented Jun 22, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20413

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 1 New Failure, 35 Pending

As of commit 0a47ed8 with merge base 05b977d (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 22, 2026
@github-actions

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@psiddh psiddh merged commit 1a78804 into pytorch:main Jun 22, 2026
195 of 204 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants