Linux Ftrace介绍与原理
生活随笔
收集整理的這篇文章主要介紹了
Linux Ftrace介绍与原理
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
Ftrace介紹
榮濤
2021年10月19日
文檔修改日志
| 日期 | 修改內容 | 修改人 | 備注 |
|---|---|---|---|
| 2021年10月19日 | 創建 | 榮濤 |
1. debugfs
默認情況下，debugfs掛載在：
/sys/kernel/debug
當然，你可以重新掛在：
mkdir /debug
sudo mount -t debugfs nodev /debug
2. tracing
2.1. /sys/kernel/debug/
# ls /sys/kernel/debug/
acpi clk error_injection intel_powerclamp pkg_temp_thermal sleep_time usb
asoc device_component extfrag iwlwifi pmc_core soundwire wakeup_sources
bdi devices_deferred fault_around_bytes kprobes pm_genpd split_huge_pages x86
block dma_buf frontswap kvm pwm sunrpc zsmalloc
bluetooth dmaengine gpio mce ras suspend_stats zswap
cec dma_pools hid mei0 regmap swiotlb
cleancache dri ieee80211 mmc0 sched_debug thunderbolt
clear_warn_once dynamic_debug intel_lpss pinctrl sched_features tracing
2.2. available_tracers
# cat /sys/kernel/debug/tracing/available_tracers
hwlat blk function_graph wakeup_dl wakeup_rt wakeup function nop
2.2.1. function|function_graph
開啟函數追蹤
echo function > /sys/kernel/debug/tracing/current_tracer
cat /sys/kernel/debug/tracing/trace
關閉函數追蹤
echo nop > /sys/kernel/debug/tracing/current_tracer
2.2.2. irqsoff
echo irqsoff > /sys/kernel/debug/tracing/current_tracer
cat /sys/kernel/debug/tracing/trace
我的環境不支持
2.3. tracing_on
關閉函數追蹤
echo 0 > /sys/kernel/debug/tracing/tracing_on
2.4. set_ftrace_filter
cat set_ftrace_filter
#### all functions enabled ####
echo schedule > /sys/kernel/debug/tracing/set_ftrace_filter
echo function > /sys/kernel/debug/tracing/current_tracer
cat /sys/kernel/debug/tracing/trace
echo "" > /sys/kernel/debug/tracing/set_ftrace_filter
echo nop > /sys/kernel/debug/tracing/current_tracer
追加
echo schedule_tail >> /sys/kernel/debug/tracing/set_ftrace_filter
cat /sys/kernel/debug/tracing/set_ftrace_filter
可以使用正則表達式：
echo 'sched*' > /sys/kernel/debug/tracing/set_ftrace_filter
cat /sys/kernel/debug/tracing/set_ftrace_filter
2.5. set_ftrace_notrace
清空：
echo > /sys/kernel/debug/tracing/set_ftrace_filter
cat /sys/kernel/debug/tracing/set_ftrace_notrace
#### no functions disabled ####
剔除：
echo '*lock*' > /sys/kernel/debug/tracing/set_ftrace_notrace
3. events
# ls /sys/kernel/debug/tracing/events
alarmtimer devlink hda iomap mdio oom regmap sunrpc wbt
asoc dma_fence hda_controller iommu mei page_isolation resctrl swiotlb workqueue
block drm hda_intel irq migrate pagemap rpm syscalls writeback
bpf_test_run enable header_event irq_matrix mmc page_pool rseq task x86_fpu
bpf_trace exceptions header_page irq_vectors module percpu rtc tcp xdp
bridge fib huge_memory kmem msr power sched thermal xen
cfg80211 fib6 hyperv kvm napi printk scsi timer xfs
cgroup filelock i2c kvmmmu neigh qdisc signal tlb xhci-hcd
clk filemap i915 kyber net random skb ucsi
compaction fs_dax initcall libata netlink ras smbus udp
context_tracking ftrace intel_iommu mac80211 nmi raw_syscalls sock vmscan
cpuhp gvt intel-sst mce nvme rcu spi vsyscall
events/sched
# ls /sys/kernel/debug/tracing/events/sched/
enable sched_pi_setprio sched_process_wait sched_stick_numa sched_wakeup_new
filter sched_process_exec sched_stat_blocked sched_swap_numa sched_waking
sched_kthread_stop sched_process_exit sched_stat_iowait sched_switch
sched_kthread_stop_ret sched_process_fork sched_stat_runtime sched_wait_task
sched_migrate_task sched_process_free sched_stat_sleep sched_wake_idle_without_ipi
sched_move_numa sched_process_hang sched_stat_wait sched_wakeup
events/sched/sched_wakeup
# ls /sys/kernel/debug/tracing/events/sched/sched_wakeup
enable filter format hist id trigger
3.1. 使能sched_wakeup event
echo nop > /sys/kernel/debug/tracing/current_tracer
echo 1 > /sys/kernel/debug/tracing/events/sched/sched_wakeup/enable
cat trace
3.2. 使能全部sched events
echo 1 > /sys/kernel/debug/tracing/events/sched/enable
3.3. 使能全部events
echo 1 > /sys/kernel/debug/tracing/events/enable
4. 參考
- Slice: Ftrace: Latency Tracing, Steven Rostedt
Copyright (C) CESTC Com.
Ftrace原理
榮濤
2021年10月19日
文檔修改日志
| 日期 | 修改內容 | 修改人 | 備注 |
|---|---|---|---|
| 2021年10月19日 | 新建 | 榮濤 |
1. ftrace原理
asmlinkage __visible void __sched schedule(void)
{struct task_struct *tsk = current;sched_submit_work(tsk);__schedule();
}
反匯編：
<schedule>:55 push %rbp48 8b 04 25 80 c0 0e mov 0xffffffff810ec080,%rax8148 89 e5 mov %rsp,%rbp48 8b 00 mov (%rax),%rax5d pop %rbpe9 db fa ff ff jmpq ffffffff810bb100 <__schedule>66 66 2e 0f 1f 84 00 data16 nopw %cs:0x0(%rax,%rax,1)00 00 00 00
添加-pg選項的反匯編
<schedule>:55 push %rbp48 89 e5 mov %rsp,%rbpe8 37 2e 00 00 callq ffffffff810f7430 <mcount>5d pop %rbp48 8b 04 25 80 d0 15 mov 0xffffffff8115d080,%rax8148 8b 00 mov (%rax),%raxe9 96 fa ff ff jmpq ffffffff810f40a0 <__schedule>66 0f 1f 44 00 00 nopw 0x0(%rax,%rax,1)
簡化schedule函數
<schedule>:push %rbpmov %rsp,%rbpcallq <mcount>pop %rbp
調用mcount
<mcount>:retq
1.1. 內核中mcount實現
以內核為例，內核里有源碼和腳本scripts/recordmcount。整體步驟如下：
- 查找所有調用mcount的位置
- 創建table
- 鏈接table到目標文件
- 新的section為__mcount_loc
<schedule>:push %rbpmov %rsp,%rbpcallq <mcount>pop %rbp[…]
<preempt_schedule_irq>:push %rbpmov %rsp,%rbppush %rbxcallq <mcount>pop %rbp[…]
<_cond_resched>:push %rbpmov %rsp,%rbppush %rbxcallq <mcount>pop %rbp[…]
<yield>:push %rbpmov %rsp,%rbppush %rbxcallq <mcount>pop %rbp[…]
__mcount_loc表：
<__mcount_loc>:&schedule + 0x4&preempt_schedule_irq + 0x4&_cond_resched + 0x4&yield + 0x4
并把__mcount_loc表加入到對應的目標文件中：
在kernel/sched/core.o：
<__mcount_loc>:&schedule + 0x4&preempt_schedule_irq + 0x4&_cond_resched + 0x4&yield + 0x4
在mm/swap.o:
<__mcount_loc>:&put_page + 0x4&__get_page_tail + 0x4&put_pages_list + 0x4&get_kernel_pages + 0x4
在fs/read_write.o：
<__mcount_loc>:&new_sync_read + 0x4&vfs_setpos + 0x4&fixed_size_llseek + 0x4&default_llseek + 0x4
在編譯vmlinux過程，如下：
然后將所有__mcount_loc表加入vmLinux中：
<__start_mcount_loc>:&schedule + 0x4&preempt_schedule_irq + 0x4&_cond_resched + 0x4&yield + 0x4&put_page + 0x4&__get_page_tail + 0x4&put_pages_list + 0x4&get_kernel_pages + 0x4&new_sync_read + 0x4&vfs_setpos + 0x4&fixed_size_llseek + 0x4&default_llseek + 0x4[...]
<___end_mcount_loc>:
而mcount中實際上都是地址：
<__start_mcount_loc>:0xffffffff810f45f40xffffffff810f46350xffffffff810f46840xffffffff810f47340xffffffff81087ad40xffffffff81087b140xffffffff81087bd50xffffffff81087c410xffffffff810a7aa00xffffffff810a7bd40xffffffff810a7d340xffffffff810a7d7d[...]
<___end_mcount_loc>:
最終的vmlinux為：
<schedule>:push %rbpmov %rsp,%rbpcallq <mcount>pop %rbp[…]
<preempt_schedule_irq>:push %rbpmov %rsp,%rbppush %rbxcallq <mcount>pop %rbp[…]
<_cond_resched>:push %rbpmov %rsp,%rbppush %rbxcallq <mcount>pop %rbp[…]
<yield>:push %rbpmov %rsp,%rbppush %rbxcallq <mcount>pop %rbp[…]
<__start_mcount_loc>:[...]
<___end_mcount_loc>:
1.2. tracing實現
- 需要一種方法，可以使能tracing
- 拋棄mcount section
- mcount section不夠用
- tracing也需要保存狀態
<ftrace_pages>如下
ip = 0xffffffff81087ad4
flags = 0
ip = 0xffffffff81087b14
flags = 0
ip = 0xffffffff81087bd5
flags = 0
ip = 0xffffffff81087c41
flags = 0
ip = 0xffffffff810a7aa0
flags = 0
ip = 0xffffffff810a7bd4
flags = 0
ip = 0xffffffff810a7d34
flags = 0
ip = 0xffffffff810a7d7d
flags = 0
ip = 0xffffffff810f45f4
flags = 0
ip = 0xffffffff810f4635
flags = 0
ip = 0xffffffff810f4684
flags = 0
ip = 0xffffffff810f4734
flags = 0
[…]
上面的選項對應：
# cat available_filter_functions
put_page
__get_page_tail
put_pages_list
get_kernel_pages
new_sync_read
vfs_setpos
fixed_size_llseek
default_llseek
schedule
preempt_schedule_irq
_cond_resched
yield
開啟tracing 過濾filter
# echo yield > set_ftrace_filter
# echo schedule >> set_ftrace_filter
# cat set_ftrace_filter
schedule
yield
- First 29 bits are for counter
- Every registered callback increments +1
- bit 29 (starts from zero) – ENABLED
- bit 30 – REGS
- bit 31 – REGS_EN
那么ftrace_pagesflags被修改為：
ip = 0xffffffff81087ad4
flags = 0
ip = 0xffffffff81087b14
flags = 0
ip = 0xffffffff81087bd5
flags = 0
ip = 0xffffffff81087c41
flags = 0
ip = 0xffffffff810a7aa0
flags = 0
ip = 0xffffffff810a7bd4
flags = 0
ip = 0xffffffff810a7d34
flags = 0
ip = 0xffffffff810a7d7d
flags = 0
ip = 0xffffffff810f45f4
flags = 0x20000001
ip = 0xffffffff810f4635
flags = 0
ip = 0xffffffff810f4684
flags = 0
ip = 0xffffffff810f4734
flags = 0xa0000001
[…]
那么，vmlinux被修改為：
<schedule>:push %rbpmov %rsp,%rbpcall ftrace_callerpop %rbp[…]
<preempt_schedule_irq>:push %rbpmov %rsp,%rbppush %rbxnoppop %rbp[…]
<_cond_resched>:push %rbpmov %rsp,%rbppush %rbxnoppop %rbp[…]
<yield>:push %rbpmov %rsp,%rbppush %rbxcall ftrace_regs_callerpop %rbp[…]
如下圖：
2. 參考
- Ftrace Kernel Hooks: More than just tracing, Steven Rostedt
Copyright (C) CESTC Com.
總結
以上是生活随笔為你收集整理的Linux Ftrace介绍与原理的全部內容，希望文章能夠幫你解決所遇到的問題。
- 上一篇： Educational Codeforc
- 下一篇： 中国2023年度电影总票房破500亿元