aboutsummaryrefslogtreecommitdiffstats
path: root/mm/percpu.c
AgeCommit message (Expand)AuthorFilesLines
2025-04-01Merge tag 'mm-stable-2025-03-30-16-52' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-1/+7
2025-03-16mm, percpu: do not consider sleepable allocations atomicMichal Hocko1-1/+7
2025-02-18percpu: Remove __per_cpu_loadBrian Gerst1-2/+2
2025-01-25mm/memblock: add memblock_alloc_or_panic interfaceGuo Weikang1-56/+14
2024-11-07mm: use page->private instead of page->index in percpuMatthew Wilcox (Oracle)1-2/+2
2024-11-06percpu: fix data race with pcpu_nr_empty_pop_pagesDennis Zhou1-3/+4
2024-09-01percpu: remove pcpu_alloc_size()Jianhui Zhou1-31/+0
2024-07-10mm: remove CONFIG_MEMCG_KMEMJohannes Weiner1-3/+3
2024-04-25mm: percpu: enable per-cpu allocation taggingSuren Baghdasaryan1-56/+6
2024-04-25mm: percpu: add codetag reference into pcpuobj_extKent Overstreet1-0/+26
2024-04-25mm: percpu: introduce pcpuobj_extKent Overstreet1-15/+15
2023-12-14mm: Introduce flush_cache_vmap_early()Alexandre Ghiti1-7/+1
2023-11-02Merge tag 'mm-stable-2023-11-01-14-33' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-5/+3
2023-10-25percpu: scoped objcg protectionRoman Gushchin1-5/+3
2023-10-20mm/percpu.c: introduce pcpu_alloc_size()Hou Tao1-0/+31
2023-10-20mm/percpu.c: don't acquire pcpu_lock for pcpu_chunk_addr_search()Hou Tao1-3/+1
2023-08-25mm/percpu.c: print error message too if atomic alloc failedBaoquan He1-2/+4
2023-08-25mm/percpu.c: optimize the code in pcpu_setup_first_chunk() a little bitBaoquan He1-23/+15
2023-08-25mm/percpu.c: remove redundant checkBaoquan He1-1/+0
2023-08-25mm/percpu: Remove some local variables in pcpu_populate_pteBibo Mao1-15/+9
2023-02-16mm: memcontrol: rename memcg_kmem_enabled()Roman Gushchin1-1/+1
2022-11-07mm/percpu.c: remove the lcm code since block size is fixed at page sizeBaoquan He1-10/+2
2022-11-07mm/percpu: replace the goto with breakBaoquan He1-2/+1
2022-11-07mm/percpu: add comment to state the empty populated pages accountingBaoquan He1-3/+11
2022-11-07mm/percpu: Update the code comment when creating new chunkBaoquan He1-5/+1
2022-11-07mm/percpu: use list_first_entry_or_null in pcpu_reclaim_populated()Baoquan He1-3/+3
2022-11-07mm/percpu: remove unused pcpu_map_extend_chunksBaoquan He1-3/+0
2022-07-17mm: percpu: use kmemleak_ignore_phys() instead of kmemleak_free()Patrick Wang1-3/+3
2022-05-13percpu: improve percpu_alloc_percpu event traceVasily Averin1-2/+3
2022-01-23Merge tag 'bitmap-5.17-rc1' of git://github.com/norov/linuxLinus Torvalds1-19/+16
2022-01-20Merge branch 'akpm' (patches from Andrew)Linus Torvalds1-34/+120
2022-01-20mm: percpu: add generic pcpu_populate_pte() functionKefeng Wang1-5/+71
2022-01-20mm: percpu: add generic pcpu_fc_alloc/free funcitonKefeng Wang1-31/+47
2022-01-20mm: percpu: add pcpu_fc_cpu_to_node_fn_t typedefKefeng Wang1-5/+9
2022-01-15bitmap: unify find_bit operationsYury Norov1-12/+8
2022-01-15mm/percpu: micro-optimize pcpu_is_populated()Yury Norov1-7/+8
2022-01-15mm: memcg/percpu: account extra objcg space to memory cgroupsQi Zheng1-5/+5
2021-11-06memblock: use memblock_free for freeing virtual pointersMike Rapoport1-4/+4
2021-11-06memblock: rename memblock_free to memblock_phys_freeMike Rapoport1-4/+4
2021-11-06memblock: drop memblock_free_early_nid() and memblock_free_early()Mike Rapoport1-4/+4
2021-09-08Merge branch 'akpm' (patches from Andrew)Linus Torvalds1-1/+0
2021-09-08percpu: remove export of pcpu_base_addrGreg Kroah-Hartman1-1/+0
2021-09-03mm/percpu,c: remove obsolete comments of pcpu_chunk_populated()Jing Xiangfeng1-3/+0
2021-07-04percpu: flush tlb in pcpu_reclaim_populated()Dennis Zhou1-6/+26
2021-07-01Merge branch 'for-5.14' of git://git.kernel.org/pub/scm/linux/kernel/git/denn...Linus Torvalds1-97/+271
2021-06-17percpu: optimize locking in pcpu_balance_workfn()Roman Gushchin1-12/+29
2021-06-14percpu: initialize best_upa variableDennis Zhou1-0/+2
2021-06-05percpu: rework memcg accountingRoman Gushchin1-81/+53
2021-05-14percpu: make symbol 'pcpu_free_slot' staticWei Yongjun1-1/+1
2021-05-07mm: fix typos in commentsIngo Molnar1-1/+1
2021-04-21percpu: implement partial chunk depopulationRoman Gushchin1-15/+165
2021-04-21percpu: use pcpu_free_slot instead of pcpu_nr_slots - 1Dennis Zhou1-6/+8
2021-04-21percpu: factor out pcpu_check_block_hint()Roman Gushchin1-7/+23
2021-04-16percpu: split __pcpu_balance_workfn()Roman Gushchin1-17/+29
2021-04-16percpu: fix a comment about the chunks orderingRoman Gushchin1-1/+4
2021-04-09percpu: make pcpu_nr_empty_pop_pages per chunk typeRoman Gushchin1-7/+7
2021-02-14percpu: fix clang modpost section mismatchDennis Zhou1-1/+1
2021-02-14percpu: reduce the number of cpu distance comparisonsWonhyuk Yang1-14/+20
2020-10-30percpu: convert flexible array initializers to use struct_size()Dennis Zhou1-4/+4
2020-10-18mm: kmem: move memcg_kmem_bypass() calls to get_mem/obj_cgroup_from_current()Roman Gushchin1-2/+1
2020-09-17percpu: fix first chunk size calculation for populated bitmapSunghyun Jin1-1/+1
2020-08-12mm: memcg/percpu: per-memcg percpu memory statisticsRoman Gushchin1-0/+10
2020-08-12mm: memcg/percpu: account percpu memory to memory cgroupsRoman Gushchin1-21/+164
2020-08-12percpu: return number of released bytes from pcpu_free_area()Roman Gushchin1-3/+10
2020-07-16treewide: Remove uninitialized_var() usageKees Cook1-1/+1
2020-06-02mm: remove the pgprot argument to __vmallocChristoph Hellwig1-1/+1
2020-05-07percpu: make pcpu_alloc() aware of current gfp contextFilipe Manana1-4/+10
2020-04-01percpu: update copyright emails to dennis@kernel.orgDennis Zhou1-1/+1
2020-01-20bitmap: genericize percpu bitmap region iteratorsDennis Zhou1-45/+16
2019-09-04percpu: Use struct_size() helperGustavo A. R. Silva1-1/+1
2019-07-23percpu: fix typo in pcpu_setup_first_chunk() commentChristophe JAILLET1-1/+1
2019-07-04percpu: Make pcpu_setup_first_chunk() void functionKefeng Wang1-12/+7
2019-06-05treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 428Thomas Gleixner1-2/+1
2019-05-13Merge branch 'for-5.2' of git://git.kernel.org/pub/scm/linux/kernel/git/denni...Linus Torvalds1-162/+387
2019-05-08percpu: remove spurious lock dependency between percpu and schedJohn Sperbeck1-1/+5
2019-03-18percpu: stop printing kernel addressesMatteo Croce1-4/+4
2019-03-13percpu: use chunk scan_hint to skip some scanningDennis Zhou1-9/+27
2019-03-13percpu: convert chunk hints to be based on pcpu_block_mdDennis Zhou1-67/+53
2019-03-13percpu: make pcpu_block_md genericDennis Zhou1-7/+13
2019-03-13percpu: use block scan_hint to only scan forwardDennis Zhou1-6/+17
2019-03-13percpu: remember largest area skipped during allocationDennis Zhou1-2/+99
2019-03-13percpu: add block level scan_hintDennis Zhou1-7/+94
2019-03-13percpu: set PCPU_BITMAP_BLOCK_SIZE to PAGE_SIZEDennis Zhou1-66/+44
2019-03-13percpu: relegate chunks unusable when failing small allocationsDennis Zhou1-9/+26
2019-03-13percpu: manage chunks based on contig_bits instead of free_bytesDennis Zhou1-1/+1
2019-03-13percpu: introduce helper to determine if two regions overlapDennis Zhou1-4/+24
2019-03-13percpu: do not search past bitmap when allocating an areaDennis Zhou1-1/+2
2019-03-13percpu: update free path with correct new free regionDennis Zhou1-1/+1
2019-03-12memblock: drop memblock_alloc_*_nopanic() variantsMike Rapoport1-7/+4
2019-03-12mm/percpu: add checks for the return value of memblock_alloc*()Mike Rapoport1-17/+56
2019-02-23percpu: use nr_groups as check conditionPeng Fan1-1/+1
2018-11-01Merge branch 'for-4.20' of git://git.kernel.org/pub/scm/linux/kernel/git/denn...Linus Torvalds1-1/+1
2018-10-31memblock: stop using implicit alignment to SMP_CACHE_BYTESMike Rapoport1-18/+20
2018-10-31mm: remove include/linux/bootmem.hMike Rapoport1-1/+1
2018-10-31memblock: remove _virt from APIs returning virtual addressMike Rapoport1-14/+14
2018-10-07percpu: stop leaking bitmap metadata blocksMike Rapoport1-0/+1
2018-09-12mm: percpu: remove unnecessary unlikely()Igor Stoppa1-1/+1
2018-08-22/proc/meminfo: add percpu populated pages countDennis Zhou (Facebook)1-0/+29
2018-04-02Merge tag 'arch-removal' of git://git.kernel.org/pub/scm/linux/kernel/git/arn...Linus Torvalds1-4/+0
2018-03-26treewide: simplify Kconfig dependencies for removed archsArnd Bergmann1-4/+0
2018-03-19mm: Allow to kill tasks doing pcpu_alloc() and waiting for pcpu_balance_workfn()Kirill Tkhai1-2/+11
2018-03-19percpu: include linux/sched.h for cond_resched()Tejun Heo1-0/+1
2018-02-23percpu: add a schedule point in pcpu_balance_workfn()Eric Dumazet1-0/+1
2018-02-18percpu: allow select gfp to be passed to underlying allocatorsDennis Zhou1-9/+7
2018-02-18percpu: add __GFP_NORETRY semantics to the percpu balancing pathDennis Zhou1-17/+27
2018-02-18percpu: match chunk allocator declarations with definitionsDennis Zhou1-2/+4
2017-11-27percpu: hack to let the CRIS architecture to boot until they clean upNicolas Pitre1-0/+4
2017-11-15Merge branch 'for-4.15' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/p...Linus Torvalds1-1/+2
2017-10-19mm, percpu: add support for __GFP_NOWARN flagDaniel Borkmann1-5/+10
2017-10-04percpu: don't forget to free the temporary struct pcpu_alloc_infoNicolas Pitre1-1/+2
2017-09-28percpu: fix iteration to prevent skipping over blockDennis Zhou1-0/+4
2017-07-26percpu: update header to contain bitmap allocator explanation.Dennis Zhou (Facebook)1-14/+18
2017-07-26percpu: update pcpu_find_block_fit to use an iteratorDennis Zhou (Facebook)1-20/+92
2017-07-26percpu: use metadata blocks to update the chunk contig hintDennis Zhou (Facebook)1-10/+70
2017-07-26percpu: update free path to take advantage of contig hintsDennis Zhou (Facebook)1-3/+65
2017-07-26percpu: update alloc path to only scan if contig hints are brokenDennis Zhou (Facebook)1-3/+56
2017-07-26percpu: keep track of the best offset for contig hintsDennis Zhou (Facebook)1-1/+12
2017-07-26percpu: skip chunks if the alloc does not fit in the contig hintDennis Zhou (Facebook)1-2/+16
2017-07-26percpu: add first_bit to keep track of the first free in the bitmapDennis Zhou (Facebook)1-2/+15
2017-07-26percpu: introduce bitmap metadata blocksDennis Zhou (Facebook)1-12/+216
2017-07-26percpu: replace area map allocator with bitmapDennis Zhou (Facebook)1-456/+273
2017-07-26percpu: generalize bitmap (un)populated iteratorsDennis Zhou (Facebook)1-24/+25
2017-07-26percpu: increase minimum percpu allocation size and align first regionsDennis Zhou (Facebook)1-7/+20
2017-07-26percpu: introduce nr_empty_pop_pages to help empty page accountingDennis Zhou (Facebook)1-3/+8
2017-07-26percpu: change the number of pages marked in the first_chunk pop bitmapDennis Zhou (Facebook)1-7/+9
2017-07-26percpu: combine percpu address checksDennis Zhou (Facebook)1-40/+11
2017-07-26percpu: modify base_addr to be region specificDennis Zhou (Facebook)1-41/+114
2017-07-26percpu: setup_first_chunk rename schunk/dchunk to chunkDennis Zhou (Facebook)1-8/+8
2017-07-26percpu: end chunk area maps page aligned for the populated bitmapDennis Zhou (Facebook)1-0/+9
2017-07-26percpu: unify allocation of schunk and dchunkDennis Zhou (Facebook)1-33/+40
2017-07-26percpu: setup_first_chunk remove dyn_size and consolidate logicDennis Zhou (Facebook)1-12/+6
2017-07-26percpu: remove has_reserved from pcpu_chunkDennis Zhou (Facebook)1-3/+0
2017-07-26percpu: introduce start_offset to pcpu_chunkDennis Zhou (Facebook)1-11/+10
2017-07-26percpu: setup_first_chunk enforce dynamic region must existDennis Zhou (Facebook)1-5/+4
2017-07-17percpu: update the header comment and pcpu_build_alloc_info commentsDennis Zhou (Facebook)1-26/+32
2017-07-17percpu: expose pcpu_nr_empty_pop_pages in pcpu_statsDennis Zhou (Facebook)1-1/+1
2017-06-21percpu: resolve err may not be initialized in pcpu_allocDennis Zhou1-1/+3
2017-06-20percpu: add tracepoint support for percpu memoryDennis Zhou1-0/+12
2017-06-20percpu: expose statistics about percpu memory via debugfsDennis Zhou1-0/+9
2017-06-20percpu: migrate percpu data structures to internal headerDennis Zhou1-23/+7
2017-06-20percpu: add missing lockdep_assert_held to func pcpu_free_areaDennis Zhou1-0/+2
2017-05-10mark most percpu globals as __ro_after_initDaniel Micay1-18/+18
2017-04-04Merge branch 'sched/core' into locking/coreThomas Gleixner1-1/+4
2017-03-26lockdep: Fix per-cpu static objectsPeter Zijlstra1-1/+4
2017-03-16locking/lockdep: Handle statically initialized PER_CPU locks properlyThomas Gleixner1-14/+23
2017-03-06percpu: acquire pcpu_lock when updating pcpu_nr_empty_pop_pagesTahsin Erdogan1-1/+4
2017-02-27scripts/spelling.txt: add "followings" pattern and fix typo instancesMasahiro Yamada1-1/+1
2016-12-13Merge branch 'for-4.10' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/p...Linus Torvalds1-1/+2
2016-12-12mm/percpu.c: fix panic triggered by BUG_ON() falselyzijun_hu1-4/+12
2016-10-19percpu: ensure the requested alignment is power of twozijun_hu1-1/+2
2016-10-05mm/percpu.c: fix potential memory leakage for pcpu_embed_first_chunk()zijun_hu1-18/+18
2016-10-05mm/percpu.c: correct max_distance calculation for pcpu_embed_first_chunk()zijun_hu1-6/+8
2016-05-25percpu: fix synchronization between synchronous map extension and chunk destr...Tejun Heo1-8/+8
2016-05-25percpu: fix synchronization between chunk->map_extend_work and chunk destructionTejun Heo1-21/+36
2016-03-17mm: percpu: use pr_fmt to prefix outputJoe Perches1-9/+11
2016-03-17mm: convert printk(KERN_<LEVEL> to pr_<level>Joe Perches1-6/+6
2016-03-17mm: coalesce split stringsJoe Perches1-2/+2
2016-03-17mm: convert pr_warning to pr_warnJoe Perches1-8/+7
2016-01-22tree wide: use kvfree() than conditional kfree()/vfree()Tetsuo Handa1-11/+7
2015-11-05mm/percpu: use offset_in_page macroAlexander Kuleshov1-5/+5
2015-07-21percpu: clean up of schunk->map[] assignment in pcpu_setup_first_chunkBaoquan He1-3/+2
2015-06-24mm: kmemleak_alloc_percpu() should follow the gfp from per_alloc()Larry Finger1-1/+1
2015-03-24percpu: Fix trivial typos in commentsYannick Guerrini1-2/+2
2015-02-13percpu: use %*pb[l] to print bitmaps including cpumasks and nodemasksTejun Heo1-4/+2
2014-10-29percpu: off by one in BUG_ON()Dan Carpenter1-1/+1
2014-10-08percpu: fix how @gfp is interpreted by the percpu allocatorTejun Heo1-1/+1
2014-09-21Revert "percpu: free percpu allocation info for uniprocessor system"Guenter Roeck1-2/+0
2014-09-09percpu: fix locking regression in the failure path of pcpu_alloc()Tejun Heo1-0/+1
2014-09-02percpu: implement asynchronous chunk populationTejun Heo1-4/+113
2014-09-02percpu: rename pcpu_reclaim_work to pcpu_balance_workTejun Heo1-15/+12
2014-09-02percpu: implmeent pcpu_nr_empty_pop_pages and chunk->nr_populatedTejun Heo1-9/+113
2014-09-02percpu: make sure chunk->map array has available spaceTejun Heo1-8/+45
2014-09-02percpu: implement [__]alloc_percpu_gfp()Tejun Heo1-25/+39
2014-09-02percpu: indent the population block in pcpu_alloc()Tejun Heo1-17/+21
2014-09-02percpu: make pcpu_alloc_area() capable of allocating only from populated areasTejun Heo1-7/+58
2014-09-02percpu: restructure lockingTejun Heo1-40/+35
2014-09-02percpu: move region iterations out of pcpu_[de]populate_chunk()Tejun Heo1-11/+8
2014-09-02percpu: move common parts out of pcpu_[de]populate_chunk()Tejun Heo1-9/+30
2014-08-16percpu: free percpu allocation info for uniprocessor systemHonggang Li1-0/+2
2014-06-19percpu: Use ALIGN macro instead of hand coding alignment calculationChristoph Lameter1-2/+1
2014-04-14percpu: make pcpu_alloc_chunk() use pcpu_mem_free() instead of kfree()Jianyu Zhan1-1/+1
2014-03-29percpu: renew the max_contig if we merge the head and previous blockJianyu Zhan1-1/+3
2014-03-17percpu: allocation size should be evenViro1-1/+4
2014-03-07percpu: speed alloc_pcpu_area() upAl Viro1-1/+17
2014-03-07percpu: store offsets instead of lengths in ->map[]Al Viro1-55/+81
2014-03-07perpcu: fold pcpu_split_block() into the only callerAl Viro1-47/+16
2014-01-21Merge branch 'akpm' (incoming from Andrew)Linus Torvalds1-16/+22
2014-01-21mm/percpu.c: use memblock apis for early memory allocationsSantosh Shilimkar1-16/+22
2014-01-21percpu: use VMALLOC_TOTAL instead of VMALLOC_END - VMALLOC_STARTLaura Abbott1-2/+2
2013-09-23percpu: fix bootmem error handling in pcpu_page_first_chunk()Michael Holzheu1-2/+3
2012-12-02mm, percpu: Make sure percpu_alloc early parameter has an argumentCyrill Gorcunov1-0/+3
2012-10-29percpu: make pcpu_free_chunk() use pcpu_mem_free() instead of kfree()Joonsoo Kim1-1/+1
2012-10-06sections: fix section conflicts in mm/percpu.cAndi Kleen1-1/+1
2012-05-09kmemleak: Fix the kmemleak tracking of the percpu areas with !SMPCatalin Marinas1-0/+2
2012-05-09percpu: pcpu_embed_first_chunk() should free unused parts after all allocs ar...Tejun Heo1-0/+10
2012-03-29percpu: use KERN_CONT in pcpu_dump_alloc_info()Tejun Heo1-5/+5
2012-01-14Merge tag 'kmemleak' of git://git.kernel.org/pub/scm/linux/kernel/git/cmarina...Linus Torvalds1-1/+11
2011-12-15percpu: fix per_cpu_ptr_to_phys() handling of non-page-aligned addressesEugene Surovegin1-2/+4
2011-12-02kmemleak: Handle percpu memory allocationCatalin Marinas1-1/+11
2011-11-23percpu: explain why per_cpu_ptr_to_phys() is more complicated than necessaryDave Young1-0/+11
generated by cgit 1.2.3-korg (git 2.43.0) at 2025-07-04 00:00:30 +0000