Skip to content

Arm backend: Support memory planning in arm_executor_runner - #21774

Merged
Erik-Lundell merged 1 commit into
pytorch:mainfrom
Erik-Lundell:upstream-support-memory-plan
Aug 12, 2026
Merged

Arm backend: Support memory planning in arm_executor_runner#21774
Erik-Lundell merged 1 commit into
pytorch:mainfrom
Erik-Lundell:upstream-support-memory-plan

Conversation

@Erik-Lundell

@Erik-Lundell Erik-Lundell commented Aug 12, 2026

Copy link
Copy Markdown
Collaborator

Support explicitly tagging tensors with mem_id = 2 for putting them in a SLOW_MEMORY_REGION and mem_id = 3 for putting in FAST_MEMORY_REGION. Keep default mem_id = 1 in SLOW_MEMORY_REGION. This gives users more flexibility in memory planning their programs.

Add a new .fast_memory input section in .sram.bss that backs the fast memory allocator. The size of the memory area is set by a new cmake flag
ET_ARM_BAREMETAL_PLANNED_FAST_MEMORY_SIZE. The slow memory region can still be allocated like planned et tensors are currently.

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

Support explicitly tagging tensors with mem_id = 2 for
putting them in a SLOW_MEMORY_REGION and mem_id = 3 for
putting in FAST_MEMORY_REGION. Keep default mem_id = 1
in SLOW_MEMORY_REGION. This gives users more flexibility
in memory planning their programs.

Add a new .fast_memory input section in .sram.bss that
backs the fast memory allocator. The size of the memory
area is set by a new cmake flag
ET_ARM_BAREMETAL_PLANNED_FAST_MEMORY_SIZE. The slow memory
region can still be allocated like planned et tensors are
currently.

Signed-off-by: Erik Lundell <erik.lundell@arm.com>
Change-Id: Iedd5bb1e0d79b707a4884d41e5219997b502f083
@Erik-Lundell Erik-Lundell added the partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm label Aug 12, 2026
@Erik-Lundell Erik-Lundell added the release notes: none Do not include this in the release notes label Aug 12, 2026
@pytorch-bot

pytorch-bot Bot commented Aug 12, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21774

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 Cancelled Job

As of commit 9359bb7 with merge base 1f19ec6 (image):

CANCELLED JOB - The following job was cancelled. Please retry:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 12, 2026
@github-actions github-actions Bot added ciflow/trunk module: arm Issues related to arm backend labels Aug 12, 2026
@Erik-Lundell
Erik-Lundell merged commit 713e159 into pytorch:main Aug 12, 2026
524 of 530 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: none Do not include this in the release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants