Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PIR] Delete ir parser #70534

Merged
merged 13 commits into from
Dec 31, 2024
Merged

Conversation

risemeup1
Copy link
Contributor

@risemeup1 risemeup1 commented Dec 28, 2024

PR Category

Execute Infrastructure

PR Types

Others

Description

删除ir parser相关逻辑和单测,对program打印进行了一些修改,具体包括:

  • 属性名称、类型名称精简
  • 针对分布式属性的打印特别长,采用黑名单机制,通过 flag 支持运行时删除这些信息的打印

pcard-67164

Copy link

paddle-bot bot commented Dec 28, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.


PHI_DEFINE_EXPORTED_string(disable_logging_value_attr_list,
"",
"Whether to disable logging value attr in PIR.");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个描述等同于没有描述😂

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

"",
"Whether to disable logging op attr in PIR.");

PHI_DEFINE_EXPORTED_string(disable_logging_value_attr_list,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

如果Op 的某个属性与 Value 的某个属性,是同一类型的属性,disable_logging_value_attr_list 会导致 op中对应属性信息也被同步删除。
除非这个 flag,最终被设计为仅仅控制 TensorDistAttr

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -360,6 +381,21 @@ void IrPrinter::PrintOperandsType(const Operation& op) {
op_operand_types.emplace_back();
}
}
// if (!FLAGS_disable_logging_value_attr_list.empty()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

delete

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -804,7 +804,7 @@ def _parallel_pir(self, mode):

# re-run apply_mix2dist_pass to dist accumulator.
apply_mix2dist_pass(dist_program)

print("dist_program:", dist_program)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

delete

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

zhangbo9674
zhangbo9674 previously approved these changes Dec 31, 2024
Copy link
Contributor

@zhangbo9674 zhangbo9674 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

SigureMo
SigureMo previously approved these changes Dec 31, 2024
Copy link
Member

@SigureMo SigureMo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTMeow 🐾 for remove test/ir/pir/test_subgraph_exporter.py and FLAGS_pir_subgraph_saving_dir

SigureMo
SigureMo previously approved these changes Dec 31, 2024
XieYunshen
XieYunshen previously approved these changes Dec 31, 2024
@SigureMo SigureMo changed the title [PIR]delete ir parser [PIR] Delete ir parser Dec 31, 2024
@risemeup1 risemeup1 merged commit 15150d4 into PaddlePaddle:develop Dec 31, 2024
31 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants