Skip to content

home: minimal#691

Open
isabelroses wants to merge 1 commit into
mainfrom
minimal-hm
Open

home: minimal#691
isabelroses wants to merge 1 commit into
mainfrom
minimal-hm

Conversation

@isabelroses

Copy link
Copy Markdown
Owner

No description provided.

@github-actions

github-actions Bot commented Apr 18, 2026

Copy link
Copy Markdown
Contributor

Nix Eval Stats: amaterasu

Metric Before (mean ± σ) After (mean ± σ) Δ %
cpuTime 18.686 ± 0.206 18.735 ± 0.240 +0.050 +0.3%
envs.bytes 273,738,624 ± 0.000 270,919,112 ± 0.000 -2,819,512 -1.0%
envs.elements 20,474,284 ± 0.000 20,277,996 ± 0.000 -196,288 -1.0%
envs.number 13,743,044 ± 0.000 13,586,893 ± 0.000 -156,151 -1.1%
gc.heapSize 1,292,107,776 ± 0.000 1,325,662,208 ± 0.000 +33,554,432 +2.6%
gc.totalBytes 2,161,727,488 ± 7334.905 2,149,231,024 ± 3885.036 -12,496,464 -0.6%
list.bytes 34,986,008 ± 0.000 34,587,712 ± 0.000 -398,296 -1.1%
list.concats 645,054 ± 0.000 643,179 ± 0.000 -1,875 -0.3%
list.elements 4,373,251 ± 0.000 4,323,464 ± 0.000 -49,787 -1.1%
nrAvoided 15,697,987 ± 0.000 15,556,355 ± 0.000 -141,632 -0.9%
nrFunctionCalls 11,910,544 ± 0.000 11,775,004 ± 0.000 -135,540 -1.1%
nrLookups 7,848,826 ± 0.000 7,758,948 ± 0.000 -89,878 -1.1%
nrOpUpdateValuesCopied 45,738,376 ± 0.000 45,698,071 ± 0.000 -40,305 -0.1%
nrOpUpdates 1,122,983 ± 0.000 1,117,681 ± 0.000 -5,302 -0.5%
nrPrimOpCalls 6,638,158 ± 0.000 6,571,001 ± 0.000 -67,157 -1.0%
nrThunks 19,399,464 ± 0.000 19,225,891 ± 0.000 -173,573 -0.9%
sets.bytes 1,045,167,072 ± 0.000 1,042,371,968 ± 0.000 -2,795,104 -0.3%
sets.elements 63,432,076 ± 0.000 63,280,009 ± 0.000 -152,067 -0.2%
sets.number 3,781,732 ± 0.000 3,736,478 ± 0.000 -45,254 -1.2%
sizes.Attr 16 ± 0.000 16 ± 0.000 0 +0.0%
sizes.Bindings 8 ± 0.000 8 ± 0.000 0 +0.0%
sizes.Env 8 ± 0.000 8 ± 0.000 0 +0.0%
sizes.Value 8 ± 0.000 8 ± 0.000 0 +0.0%
symbols.bytes 1,352,301 ± 0.000 1,311,241 ± 0.000 -41,060 -3.0%
symbols.number 113,285 ± 0.000 110,075 ± 0.000 -3,210 -2.8%
values.bytes 0 ± 0.000 0 ± 0.000 0 N/A
values.number 0 ± 0.000 0 ± 0.000 0 N/A

@isabelroses

Copy link
Copy Markdown
Owner Author

can't seem to reproduce the eval speed improvments that CI seems to get

@github-actions

This comment was marked as outdated.

@isabelroses isabelroses force-pushed the minimal-hm branch 3 times, most recently from f3728e1 to 7bfb277 Compare April 20, 2026 12:08
@isabelroses isabelroses force-pushed the minimal-hm branch 2 times, most recently from 82c83c7 to c9f0e4c Compare May 12, 2026 19:46
@github-actions

github-actions Bot commented May 12, 2026

Copy link
Copy Markdown
Contributor

Nix Eval Stats

Paired comparison across 7 host(s). Metrics with identical values across all hosts are listed under Unchanged; the rest get a paired t-test (p-value, t-stat).

Unchanged values

metric value
sizes.Attr1 16
sizes.Bindings2 8
sizes.Env3 8
sizes.Value4 8

Updated values

metric mean_before mean_after mean_diff mean_pct_change p_value t_stat
time.cpu5 9.4963 1.3532 -8.1431 -80.2801 0.0027 -4.9012
time.gc6 0.6611 0.0656 -0.5956 -85.5196 0.0024 -5.0427
time.gcFraction7 0.0701 0.0156 -0.0545 -78.8442 0.0011 -5.8333
gc.cycles8 4.7143 1.4286 -3.2857 -67.6190 0.0016 -5.4212
gc.heapSize9 851106669.7143 424486034.2857 -426620635.4286 -46.5816 0.0026 -4.9425
gc.totalBytes10 1220735684.5714 233962338.2857 -986773346.2857 -76.2836 0.0017 -5.3515
envs.bytes11 150466212.5714 27584025.1429 -122882187.4286 -77.8200 0.0015 -5.4957
list.bytes12 18794413.7143 4145398.8571 -14649014.8571 -74.0669 0.0017 -5.4084
sets.bytes13 591839682.2857 114775105.1429 -477064577.1429 -75.6276 0.0019 -5.2616
symbols.bytes14 1207822.1429 714781.1429 -493041.0000 -40.0523 0.0010 -5.9126
values.bytes15 9201305.1429 1367877.7143 -7833427.4286 -80.6484 0.0018 -5.3337
envs.number16 7383599.7143 1430812.2857 -5952787.4286 -77.0344 0.0014 -5.5553
nrAvoided17 8424434.2857 1466720.2857 -6957714.0000 -78.4215 0.0017 -5.4005
nrExprs18 5316104.4286 2407666.8571 -2908437.5714 -53.3307 0.0010 -5.9101
nrFunctionCalls19 6245690.4286 1222862.8571 -5022827.5714 -76.8359 0.0014 -5.5522
nrLookups20 4022373.1429 718206.7143 -3304166.4286 -78.6433 0.0014 -5.5994
nrOpUpdateValuesCopied21 25027512.0000 4910217.4286 -20117294.5714 -75.1862 0.0020 -5.2116
nrOpUpdates22 633585.4286 78400.8571 -555184.5714 -82.7765 0.0020 -5.2082
nrPrimOpCalls23 2958545.1429 601766.7143 -2356778.4286 -76.1707 0.0014 -5.5577
nrThunks24 10069038.4286 1857532.4286 -8211506.0000 -77.7030 0.0015 -5.5289
sets.number25 2380993.4286 466092.7143 -1914900.7143 -76.5435 0.0016 -5.4584
symbols.number26 99656.0000 61630.4286 -38025.5714 -37.5388 0.0010 -5.9374
values.number27 1150163.1429 170984.7143 -979178.4286 -80.6484 0.0018 -5.3337
envs.elements28 11424676.8571 2017190.8571 -9407486.0000 -78.3269 0.0016 -5.4559
list.concats29 358277.2857 42652.4286 -315624.8571 -82.8170 0.0021 -5.1659
list.elements30 2349301.7143 518174.8571 -1831126.8571 -74.0669 0.0017 -5.4084
sets.elements31 35799483.4286 6940397.7143 -28859085.7143 -75.5959 0.0019 -5.2530

Footnotes

  1. Size in bytes of the Attr type.

  2. Size in bytes of the Bindings type.

  3. Size in bytes of the Env type.

  4. Size in bytes of the Value type.

  5. Number of seconds of CPU time accounted by the OS to the Nix evaluator process. On UNIX systems, this comes from getrusage(RUSAGE_SELF).

  6. Number of seconds of CPU time accounted by the Boehm garbage collector to performing GC.

  7. What fraction of the total CPU time is accounted towards performing GC.

  8. Number of times garbage collection has been performed.

  9. Size in bytes of the garbage collector heap.

  10. Size in bytes of all allocations in the garbage collector.

  11. Size in bytes of all Env objects allocated by the Nix evaluator.

  12. Size in bytes of all lists allocated by the Nix evaluator.

  13. Size in bytes of all attrsets allocated by the Nix evaluator.

  14. Size in bytes of all items in the Nix evaluator symbol table.

  15. Size in bytes of all values allocated by the Nix evaluator.

  16. The count of all Env objects allocated.

  17. The number of thunks avoided being created.

  18. The number of expression objects ever created.

  19. The number of function calls ever made.

  20. The number of lookups into an attrset ever made.

  21. The number of attrset values copied in the process of merging attrsets.

  22. The number of attrset merge operations (//) performed.

  23. The number of function calls to primops (Nix builtins) ever made.

  24. The number of thunks ever made.

  25. The number of attrsets ever made.

  26. The number of symbols ever added to the symbol table.

  27. The number of values ever made.

  28. The number of values contained within an Env object.

  29. The number of list concatenation operations (++) performed.

  30. The number of values contained within a list.

  31. The number of values contained within an attrset.

@isabelroses isabelroses force-pushed the minimal-hm branch 2 times, most recently from d46cda5 to 536b50b Compare May 15, 2026 14:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant