aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring
AgeCommit message (Expand)AuthorFilesLines
2025-04-30io_uring/fdinfo: annotate racy sq/cq head/tail readsJens Axboe1-2/+2
2025-04-24io_uring: fix 'sync' handling of io_fallback_tw()Jens Axboe1-6/+7
2025-04-24io_uring: don't duplicate flushing in io_req_post_cqePavel Begunkov1-3/+8
2025-04-18io_uring/zcrx: fix late dma unmap for a dead devPavel Begunkov2-4/+18
2025-04-17io_uring/rsrc: ensure segments counts are correct on kbuf buffersJens Axboe1-5/+22
2025-04-17io_uring/rsrc: send exact nr_segs for fixed bufferNitesh Shetty1-3/+4
2025-04-17io_uring/rsrc: refactor io_import_fixedPavel Begunkov1-17/+7
2025-04-17io_uring/rsrc: separate kbuf offset adjustmentsPavel Begunkov1-12/+7
2025-04-17io_uring/rsrc: don't skip offset calculationPavel Begunkov1-38/+37
2025-04-15io_uring/zcrx: add pp to ifq conversion helperPavel Begunkov1-4/+9
2025-04-15io_uring/zcrx: return ifq id to the userPavel Begunkov1-1/+2
2025-04-07io_uring/kbuf: reject zero sized provided buffersJens Axboe1-0/+2
2025-04-07io_uring/zcrx: separate niov number from pagesPavel Begunkov2-9/+11
2025-04-07io_uring/zcrx: put refill data into separate cache linePavel Begunkov1-2/+2
2025-04-04io_uring: don't post tag CQEs on file/buffer registration failurePavel Begunkov1-1/+16
2025-04-03io_uring: always do atomic put from iowqPavel Begunkov2-1/+8
2025-04-02io_uring: support vectored kernel fixed bufferMing Lei1-3/+88
2025-04-02io_uring: add validate_fixed_range() for validate fixed bufferMing Lei1-11/+22
2025-04-01io_uring/zcrx: return early from io_zcrx_recv_skb if readlen is 0David Wei1-0/+8
2025-03-31io_uring/net: avoid import_ubuf for regvec sendPavel Begunkov1-0/+2
2025-03-31io_uring/rsrc: check size when importing reg bufferPavel Begunkov1-0/+2
2025-03-31io_uring: cleanup {g,s]etsockopt sqe readingPavel Begunkov1-8/+10
2025-03-31io_uring: hide caches sqes from driversPavel Begunkov2-2/+3
2025-03-31io_uring: make zcrx depend on CONFIG_IO_URINGPavel Begunkov1-0/+1
2025-03-31io_uring: add req flag invariant build assertionPavel Begunkov1-0/+2
2025-03-28io_uring: don't pass ctx to tw add remote helperPavel Begunkov3-11/+8
2025-03-28io_uring/msg: initialise msg request opcodePavel Begunkov1-0/+1
2025-03-28io_uring/msg: rename io_double_lock_ctx()Pavel Begunkov1-4/+4
2025-03-28io_uring/net: import zc ubuf earlierPavel Begunkov1-28/+16
2025-03-28io_uring/net: set sg_from_iter in advancePavel Begunkov1-10/+15
2025-03-28io_uring/net: clusterise send vs msghdr branchesPavel Begunkov1-11/+4
2025-03-28io_uring/net: unify sendmsg setup with zcPavel Begunkov1-22/+6
2025-03-28io_uring/net: combine sendzc flags writesPavel Begunkov1-2/+1
2025-03-28io_uring/net: open code io_net_vec_assign()Pavel Begunkov1-11/+5
2025-03-28io_uring/net: open code io_sendmsg_copy_hdr()Pavel Begunkov1-20/+10
2025-03-28io_uring/net: account memory for zc sendmsgPavel Begunkov1-1/+11
2025-03-28Merge tag 'for-6.15/io_uring-reg-vec-20250327' of git://git.kernel.dk/linuxLinus Torvalds13-210/+534
2025-03-28Merge tag 'for-6.15/io_uring-epoll-wait-20250325' of git://git.kernel.dk/linuxLinus Torvalds4-6/+54
2025-03-28Merge tag 'for-6.15/io_uring-rx-zc-20250325' of git://git.kernel.dk/linuxLinus Torvalds13-1/+1173
2025-03-27io_uring/net: fix io_req_post_cqe abuse by send bundlePavel Begunkov2-2/+3
2025-03-26Merge tag 'net-next-6.15' of git://git.kernel.org/pub/scm/linux/kernel/git/ne...Linus Torvalds1-2/+2
2025-03-26Merge tag 'for-6.15/io_uring-20250322' of git://git.kernel.dk/linuxLinus Torvalds27-851/+970
2025-03-26io_uring/net: use REQ_F_IMPORT_BUFFER for send_zcCaleb Sander Mateos1-5/+5
2025-03-25Merge tag 'lsm-pr-20250323' of git://git.kernel.org/pub/scm/linux/kernel/git/...Linus Torvalds1-7/+14
2025-03-25io_uring: move min_events sanitisationPavel Begunkov1-9/+7
2025-03-25io_uring: rename "min" arg in io_iopoll_check()Pavel Begunkov1-4/+4
2025-03-25io_uring: open code __io_post_aux_cqe()Pavel Begunkov1-12/+2
2025-03-25io_uring: defer iowq cqe overflow via task_workPavel Begunkov1-4/+7
2025-03-25io_uring: fix retry handling off iowqPavel Begunkov1-1/+1
2025-03-25Merge tag 'timers-cleanups-2025-03-23' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds2-8/+7
2025-03-22Merge tag 'io_uring-6.14-20250322' of git://git.kernel.dk/linuxLinus Torvalds1-0/+2
2025-03-22io_uring/net: fix sendzc double notif flushPavel Begunkov1-0/+2
2025-03-21io_uring/net: only import send_zc buffer onceCaleb Sander Mateos1-1/+4
2025-03-21io_uring/cmd: introduce io_uring_cmd_import_fixed_vecPavel Begunkov2-0/+25
2025-03-21io_uring/cmd: add iovec cache for commandsPavel Begunkov4-3/+28
2025-03-21Merge tag 'io_uring-6.14-20250321' of git://git.kernel.dk/linuxLinus Torvalds1-2/+1
2025-03-20io_uring: enable toggle of iowait usage when waiting on CQEsJens Axboe1-13/+19
2025-03-20io_uring/net: don't clear REQ_F_NEED_CLEANUP unconditionallyJens Axboe1-2/+1
2025-03-19io_uring/cmd: don't expose entire cmd async dataPavel Begunkov4-9/+19
2025-03-19io_uring: rename the data cmd cachePavel Begunkov2-4/+4
2025-03-13Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netPaolo Abeni1-4/+3
2025-03-10io_uring/kbuf: enable bundles for incrementally consumed buffersJens Axboe1-30/+26
2025-03-10Revert "io_uring/rsrc: simplify the bvec iter count calculation"Keith Busch1-1/+3
2025-03-10io_uring: rely on io_prep_reg_vec for iovec placementPavel Begunkov4-11/+7
2025-03-10io_uring: introduce io_prep_reg_iovec()Pavel Begunkov4-40/+32
2025-03-10io_uring: unify STOP_MULTISHOT with IOU_OKPavel Begunkov5-28/+9
2025-03-10io_uring: return -EAGAIN to continue multishotPavel Begunkov5-44/+29
2025-03-07Merge tag 'io_uring-6.14-20250306' of git://git.kernel.dk/linuxLinus Torvalds1-4/+3
2025-03-07io_uring: Remove unused declaration io_alloc_async_data()Yue Haibing1-1/+0
2025-03-07io_uring: cap cached iovec/bvec sizePavel Begunkov3-0/+8
2025-03-07io_uring/net: implement vectored reg bufs for zctxPavel Begunkov1-4/+55
2025-03-07io_uring/net: convert to struct iou_vecPavel Begunkov3-41/+25
2025-03-07io_uring/net: pull vec alloc out of msghdr importPavel Begunkov1-8/+15
2025-03-07io_uring/net: combine msghdr copyPavel Begunkov1-27/+19
2025-03-07io_uring/rw: defer reg buf vec importPavel Begunkov1-8/+34
2025-03-07io_uring/rw: implement vectored registered rwPavel Begunkov3-0/+92
2025-03-07io_uring: add infra for importing vectored reg buffersPavel Begunkov2-0/+133
2025-03-07io_uring: introduce struct iou_vecPavel Begunkov4-12/+34
2025-03-07Merge branch 'for-6.15/io_uring-epoll-wait' into for-6.15/io_uring-reg-vecJens Axboe4-6/+54
2025-03-07Merge branch 'for-6.15/io_uring-rx-zc' into for-6.15/io_uring-reg-vecJens Axboe13-1/+1173
2025-03-06Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski1-1/+3
2025-03-05io_uring/rw: ensure reissue path is correctly handled for IOPOLLJens Axboe1-4/+3
2025-03-05io_uring: introduce io_cache_free() helperCaleb Sander Mateos4-15/+13
2025-03-04io_uring/rsrc: skip NULL file/buffer checks in io_free_rsrc_node()Caleb Sander Mateos1-4/+2
2025-03-04io_uring/rsrc: avoid NULL node check on io_sqe_buffer_register() failureCaleb Sander Mateos1-2/+1
2025-03-04io_uring/rsrc: call io_free_node() on io_sqe_buffer_register() failureCaleb Sander Mateos1-2/+1
2025-03-04io_uring/rsrc: free io_rsrc_node using kfree()Caleb Sander Mateos1-1/+1
2025-03-04io_uring/rsrc: split out io_free_node() helperCaleb Sander Mateos1-2/+7
2025-03-04io_uring/rsrc: include io_uring_types.h in rsrc.hCaleb Sander Mateos1-0/+1
2025-02-28io_uring/nop: use io_find_buf_node()Caleb Sander Mateos1-11/+2
2025-02-28io_uring/rsrc: declare io_find_buf_node() in header fileCaleb Sander Mateos2-2/+4
2025-02-28io_uring/ublk: report error when unregister operation failsCaleb Sander Mateos1-4/+14
2025-02-28io_uring/uring_cmd: specify io_uring_cmd_import_fixed() pointer typeCaleb Sander Mateos1-1/+2
2025-02-28io_uring/rsrc: use rq_data_dir() to compute bvec dirCaleb Sander Mateos1-5/+1
2025-02-28Merge tag 'io_uring-6.14-20250228' of git://git.kernel.dk/linuxLinus Torvalds1-1/+3
2025-02-28io_uring: cache nodes and mapped buffersKeith Busch4-16/+63
2025-02-28io_uring: add support for kernel registered bvecsKeith Busch4-7/+131
2025-02-28io_uring/rw: move fixed buffer import to issue pathKeith Busch3-11/+34
2025-02-28io_uring/rw: move buffer_select outside generic prepKeith Busch1-17/+28
2025-02-27Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski4-20/+41
2025-02-27io_uring/net: fix build warning for !CONFIG_COMPATArnd Bergmann1-6/+0
2025-02-27io_uring: rearrange opdef flags by use patternPavel Begunkov1-6/+6
2025-02-27io_uring/net: extract iovec import into a helperPavel Begunkov1-34/+28
2025-02-27io_uring/net: unify *mshot_prep calls with compatPavel Begunkov1-7/+7
2025-02-27io_uring/net: derive iovec storage laterPavel Begunkov1-22/+21
2025-02-27io_uring/net: verify msghdr before copying iovecPavel Begunkov1-25/+18
2025-02-27io_uring/net: isolate msghdr copying codePavel Begunkov1-20/+25
2025-02-27io_uring/net: simplify compat selbuf iov parsingPavel Begunkov1-8/+4
2025-02-27io_uring/net: remove unnecessary REQ_F_NEED_CLEANUPPavel Begunkov1-9/+2
2025-02-27Merge branch 'io_uring-6.14' into for-6.15/io_uringJens Axboe5-21/+44
2025-02-27io_uring: combine buffer lookup and importPavel Begunkov5-50/+41
2025-02-27io_uring/nvme: pass issue_flags to io_uring_cmd_import_fixed()Pavel Begunkov1-1/+2
2025-02-27io_uring/net: reuse req->buf_index for sendzcPavel Begunkov1-3/+2
2025-02-27io_uring/nop: reuse req->buf_indexKeith Busch1-5/+2
2025-02-27io_uring/rsrc: remove redundant check for valid imuKeith Busch1-11/+8
2025-02-27io_uring/rw: open code io_prep_rw_setup()Pavel Begunkov1-16/+9
2025-02-25io_uring/net: save msg_control for compatPavel Begunkov1-1/+3
2025-02-25io_uring/rw: extract helper for iovec importPavel Begunkov1-26/+31
2025-02-25io_uring/rw: rename io_import_iovec()Pavel Begunkov1-7/+7
2025-02-25io_uring/rw: allocate async data in io_prep_rw()Pavel Begunkov1-3/+3
2025-02-24io_uring/zcrx: add a read limit to recvzc requestsDavid Wei3-9/+24
2025-02-24io_uring: make io_poll_issue() sturdierPavel Begunkov1-7/+33
2025-02-24io_uring/net: canonise accept mshot handlingPavel Begunkov1-9/+4
2025-02-24io_uring/net: fix accept multishot handlingPavel Begunkov1-0/+2
2025-02-24io_uring/net: use io_is_compat()Pavel Begunkov1-11/+8
2025-02-24io_uring/waitid: use io_is_compat()Pavel Begunkov1-5/+1
2025-02-24io_uring/rw: shrink io_iov_compat_buffer_select_prepPavel Begunkov1-10/+4
2025-02-24io_uring/rw: compile out compat param passingPavel Begunkov1-6/+2
2025-02-24io_uring/cmd: optimise !CONFIG_COMPAT flags settingPavel Begunkov1-1/+1
2025-02-24io_uring: introduce io_is_compat()Pavel Begunkov1-0/+5
2025-02-21Merge tag 'io_uring-6.14-20250221' of git://git.kernel.dk/linuxLinus Torvalds4-20/+41
2025-02-21io_uring: add missing IORING_MAP_OFF_ZCRX_REGION in io_uring_mmapBui Quang Minh1-0/+2
2025-02-20Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski3-32/+30
2025-02-20io_uring/epoll: add support for IORING_OP_EPOLL_WAITJens Axboe3-0/+49
2025-02-20io_uring/epoll: remove CONFIG_EPOLL guardsJens Axboe2-6/+5
2025-02-20Merge branch 'for-6.15/io_uring-rx-zc' into for-6.15/io_uring-epoll-waitJens Axboe12-1/+1156
2025-02-19io_uring: Rename KConfig to KconfigGeert Uytterhoeven1-0/+0
2025-02-19io_uring/zcrx: fix leaks on failed registrationPavel Begunkov1-1/+2
2025-02-19io_uring/rw: clean up mshot forced sync modePavel Begunkov1-9/+3
2025-02-19io_uring/rw: move ki_complete init into prepPavel Begunkov1-3/+8
2025-02-19io_uring/rw: don't directly use ki_completePavel Begunkov1-5/+9
2025-02-19io_uring/rw: forbid multishot async readsPavel Begunkov1-2/+11
2025-02-19io_uring/zcrx: recheck ifq on shutdownPavel Begunkov1-3/+3
2025-02-19io_uring/rsrc: remove unused constantsCaleb Sander Mateos1-6/+0
2025-02-18io_uring: use lockless_cq flag in io_req_complete_post()Caleb Sander Mateos1-1/+1
2025-02-18io_uring: Use helper function hrtimer_update_function()Nam Cao1-1/+1
2025-02-18io_uring/timeout: Switch to use hrtimer_setup()Nam Cao1-7/+6
2025-02-17net: use napi_id_valid helperStefano Jordhani1-2/+2
2025-02-17io_uring/zcrx: add copy fallbackPavel Begunkov1-6/+114
2025-02-17io_uring/zcrx: throttle receive requestsPavel Begunkov2-0/+11
2025-02-17io_uring/zcrx: set pp memory provider for an rx queueDavid Wei1-8/+41
2025-02-17io_uring/zcrx: add io_recvzc requestDavid Wei5-1/+300
2025-02-17io_uring/zcrx: dma-map area for the devicePavel Begunkov2-1/+82
2025-02-17io_uring/zcrx: implement zerocopy receive pp memory providerPavel Begunkov2-0/+277
2025-02-17io_uring/zcrx: grab a net devicePavel Begunkov2-0/+33
2025-02-17io_uring/zcrx: add io_zcrx_areaDavid Wei4-3/+105
2025-02-17io_uring/zcrx: add interface queue and refill queueDavid Wei7-0/+210
2025-02-17io_uring: pass struct io_tw_state by valueCaleb Sander Mateos1-7/+7
2025-02-17io_uring: introduce type alias for io_tw_stateCaleb Sander Mateos12-55/+58
2025-02-17io_uring/rsrc: avoid NULL check in io_put_rsrc_node()Caleb Sander Mateos2-2/+3
2025-02-17io_uring: pass ctx instead of req to io_init_req_drain()Caleb Sander Mateos1-3/+2
2025-02-17io_uring: use IO_REQ_LINK_FLAGS moreCaleb Sander Mateos1-3/+4
2025-02-17io_uring/net: improve recv bundlesJens Axboe1-0/+18
2025-02-17io_uring/waitid: use generic io_cancel_remove() helperJens Axboe1-23/+1
2025-02-17io_uring/futex: use generic io_cancel_remove() helperJens Axboe1-23/+1
2025-02-17io_uring/cancel: add generic cancel helperJens Axboe2-0/+25
2025-02-17io_uring/waitid: convert to io_cancel_remove_all()Jens Axboe1-17/+3
2025-02-17io_uring/futex: convert to io_cancel_remove_all()Jens Axboe1-17/+3
2025-02-17io_uring/cancel: add generic remove_all helperJens Axboe2-0/+25
2025-02-17io_uring/kbuf: uninline __io_put_kbufsPavel Begunkov2-64/+70
2025-02-17io_uring/kbuf: introduce io_kbuf_drop_legacy()Pavel Begunkov3-23/+13
2025-02-17io_uring/kbuf: open code __io_put_kbuf()Pavel Begunkov2-8/+1
2025-02-17io_uring/kbuf: remove legacy kbuf cachingPavel Begunkov3-55/+9
2025-02-17io_uring/kbuf: simplify __io_put_kbufPavel Begunkov2-27/+6
2025-02-17io_uring/kbuf: move locking into io_kbuf_drop()Pavel Begunkov2-6/+3
2025-02-17io_uring/kbuf: remove legacy kbuf kmem cachePavel Begunkov3-7/+2
2025-02-17io_uring/kbuf: remove legacy kbuf bulk allocationPavel Begunkov1-25/+5
2025-02-17io_uring: sanitise ring params earlierPavel Begunkov1-33/+44
2025-02-17io_uring: check for iowq alloc_workqueue failurePavel Begunkov1-0/+1
2025-02-17io_uring: deduplicate caches deallocationPavel Begunkov1-12/+12
2025-02-17io_uring/io-wq: pass io_wq to io_get_next_work()Max Kellermann1-3/+2
2025-02-17io_uring/io-wq: do not use bogus hash valueMax Kellermann1-1/+3
2025-02-17io_uring/io-wq: cache work->flags in variableMax Kellermann2-13/+27
2025-02-17io_uring/io-wq: move worker lists to struct io_wq_acctMax Kellermann1-66/+96
2025-02-17io_uring/io-wq: add io_worker.acct pointerMax Kellermann1-15/+8
2025-02-17io_uring/io-wq: eliminate redundant io_work_get_acct() callsMax Kellermann1-5/+4
2025-02-15io_uring: prevent opcode speculationPavel Begunkov1-0/+2
2025-02-14io-wq: backoff when retrying worker creationUday Shankar1-5/+18
2025-02-14Merge tag 'io_uring-6.14-20250214' of git://git.kernel.dk/linuxLinus Torvalds3-32/+30
2025-02-13io_uring/uring_cmd: unconditionally copy SQEs at prep timeJens Axboe1-23/+11
2025-02-12io_uring/waitid: setup async data in the prep handlerJens Axboe1-7/+7
2025-02-12io_uring/uring_cmd: remove dead req_has_async_data() checkJens Axboe1-3/+0
2025-02-12io_uring/uring_cmd: switch sqe to async_data on EAGAINCaleb Sander Mateos1-9/+14
2025-02-12io_uring/uring_cmd: don't assume io_uring_cmd_data layoutCaleb Sander Mateos1-1/+1
2025-02-12io_uring/kbuf: reallocate buf lists on upgradePavel Begunkov1-4/+12
2025-02-12io_uring/waitid: don't abuse io_tw_statePavel Begunkov1-2/+2
2025-02-08Merge tag 'locking-urgent-2025-02-08' of git://git.kernel.org/pub/scm/linux/k...Linus Torvalds1-1/+1
2025-02-07io_uring,lsm,selinux: add LSM hooks for io_uring_setup()Hamza Mahfooz1-2/+3
2025-02-07io_uring: refactor io_uring_allowed()Hamza Mahfooz1-7/+13
2025-01-31Merge tag 'io_uring-6.14-20250131' of git://git.kernel.dk/linuxLinus Torvalds19-241/+269