[AutoParallel] Add test for PIR refined recompute

[waliwali777]

PR types

Others

PR changes

Others

Description

Judge refined_ops_patterns training args.
Add test for PIR refined recompute.

在 yaml 文件中的调用举例：

 enable_auto_parallel: 1
 to_static: 1
 recompute: 1
 refined_ops_patterns:
        - {main_ops: [flash_attn], num: -1, pre_ops: [], suf_ops: []}
        - {main_ops: [matmul], num: 2, pre_ops: [], suf_ops: [add]}

在python命令行参数中的调用举例

python -u -m paddle.distributed.launch \
                    --gpus "0,1,2,3" \
                    --log_dir $case_log_dir \
                    run_pretrain_auto.py \
                    --to_static \
                    --enable_auto_parallel 1 \ 
                    --recompute 1 \
                    --refined_ops_patterns '[{"main_ops":["matmul"],"num":-1,"pre_ops":["softmax"],"suf_ops":[]}]' \
                   ...

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 40.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 52.34%. Comparing base (fa3fd39) to head (04cf542).
Report is 4 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/training_args.py	40.00%	3 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9679      +/-   ##
===========================================
+ Coverage    51.11%   52.34%   +1.23%     
===========================================
  Files          730      721       -9     
  Lines       122587   113897    -8690     
===========================================
- Hits         62657    59622    -3035     
+ Misses       59930    54275    -5655     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.