Issues for Buiding Astra-sim and Running Chakra Trace Generator

[Y-y Hsieh (謝伊妍)]

Dear ASTRA-sim developers,

I am Yi-Yen Hsieh from MediaTek, our department had a deep discussion with Prof. Tushar Krishna at the SRC Asia Visit in May.

In order to see if there are some opportunities for advanced AI processor architecture development, we are currently investigating the tools of ASTRA-sim and its series.

Due to GitHub regulatory policy of our company, I followed the instructions on the website for the dependency setup and build ASTRA-sim and installed all the packages manually.

https://astra-sim.github.io/astra-sim-docs/index.html

First of all, I installed the requirements for Chakra and ASTRA-sim.

However, when I tried to build the ASTRA-sim, I encountered the following error message, 

When I turned to chakra GitHub page, there was no et_def.pb.h 

https://github.com/mlcommons/chakra/tree/main/src/feeder

Would you please help me to find out that if I missed some steps or what else I should do to fix the problem?

//

In addition, when I installed Chakra successfully (including PARAM and Holistic Trace Analysis) and tried to run the execution trace generator, the error message is the following. 

The current tool version is: Python 3.12.3, grpcio == 1.64.1, grpcio-tools == 1.64.1, protobuf == 5.29.5.

Could you please assist me with the correct module path setting and also provide some toy input files for a trial? Thank you so much.

Much appreciated,

Yi-Yen

************* MEDIATEK Confidentiality Notice
 ********************
The information contained in this e-mail message (including any 
attachments) may be confidential, proprietary, privileged, or otherwise
exempt from disclosure under applicable laws. It is intended to be 
conveyed only to the designated recipient(s). Any use, dissemination, 
distribution, printing, retaining or copying of this e-mail (including its 
attachments) by unintended recipient(s) is strictly prohibited and may 
be unlawful. If you are not an intended recipient of this e-mail, or believe
 
that you have received this e-mail in error, please notify the sender 
immediately (by replying to this e-mail), delete any and all copies of 
this e-mail (including any attachments) from your system, and do not
disclose the content of this e-mail to any other person. Thank you!

[Y-y Hsieh (謝伊妍)]

Hi Sharon, 

After setting the correct path to the Chakra, the first issue was solved.

Accordingly, I have built ASTRA-sim successfully, thanks for the kind help.

For the second question about Chakra, the issue is the same as the following,

if you have some suggestions, please let me know, thank you.

https://github.com/mlcommons/chakra/issues/174

Best regards,

Yi-Yen

---

From: Y-y Hsieh (謝伊妍) <Y-y....@mediatek.com>
Sent: Monday, June 9, 2025 5:42 PM
To: sharon <sha...@optimalnets.com>
Subject: Re: [SPAM]Private message regarding: Issues for Buiding Astra-sim and Running Chakra Trace Generator

 

Hi Sharon, 

Both solutions did not work out for me. I built the Astra-sim and Chakra in a Python virtual environment.

Due to the regulatory policy in my company, I cannot  directly access the github.com on the server,

I was supposed to download the .zip files recursively and manually and then upload these folders to the server.

Besides, I have confirmed that the protobuf tool chain was installed successfully.

Could you please provide the recommended compatible version for the following packages? grpcio, grpcio-tools, protobuf, protobuf-compiler

I think it may related to the issue: https://github.com/astra-sim/astra-sim/issues/300

But my error message was still the following, only et_def.pb.h could not be compiled out.

For Chakra version micro2024, I followed the following 4 files, but it turned to fail. 

I have confirmed that /param/et_replay and Chakra were installed successfully.

If there are any further suggestions, please let me know, thank you for your kind help.

[Chakra]

[Chakra/param/et_replay]

[When running  chakra et_generator, it still failed.]

Best regards,

Yi-Yen

---

From: sharon <sha...@optimalnets.com>
Sent: Monday, June 9, 2025 4:40 PM
To: Y-y Hsieh (謝伊妍) <Y-y....@mediatek.com>
Subject: [SPAM]Private message regarding: Issues for Buiding Astra-sim and Running Chakra Trace Generator

 

External email : Please do not click links or open attachments until you have verified the sender or the content.

Hi  Yi-Yen.

The file et_def.pb.h is probably created by the protobuf compiler. I would check to see if you have an earlier error, probably when the Astra-Sim toolchain tries to activate the protobuf compiler, protoc. Maybe you need to "apt-install" the protobuf toolchain in advance. In any case, for reference, you can clone the tutorial repository  https://github.com/astra-sim/tutorials.git, and run one of the Astra-Sim compilation scripts, which worked for me (for example, the script {cloned_dir}/astra-sim-tutorials/micro2024/compile_astra_sim.sh).

For the second issue, I would clone the Chakra repository (https://github.com/mlcommons/chakra) in a different folder, and install it using the Python Virtual Environment (follow the README.md). That also worked for me.

Please let me know if it worked for you.

Sharon

[sfsharon]

Hi  Yi-Yen.

After a little more digging, it seems that the tool chakra.et_generator.et_generator is not available in the chakra repository. Maybe it was removed it the past, and the only mentioning of it is in chakra's User Guide document :  

    sharon@sharon:~/workspace/chakra_components/chakra (main)* $ git remote -vv
    origin  https://github.com/mlcommons/chakra.git (fetch)
    origin  https://github.com/mlcommons/chakra.git (push)

    sharon@sharon:~/workspace/chakra_components/chakra (main)* $ git status
    On branch main
    Your branch is up to date with 'origin/main'.
    sharon@sharon:~/workspace/chakra_components/chakra (main)* $ grep -irn "et_generator"
    USER_GUIDE.md:93:$ python -m chakra.et_generator.et_generator\

If you are trying to generate synthetic chakra files, I would go and take a look at the examples in the Astra-Sim tutorials :

For example, in {astra-sim tutorial folder}/micro2024/chakra-demo/demo1 :

sharon@sharon:~/workspace/astra-sim-tutorials/micro2024/chakra-demo/demo1 (main)* $ mkdir traces
sharon@sharon:~/workspace/astra-sim-tutorials/micro2024/chakra-demo/demo1 (main)* $ cd traces/
sharon@sharon:~/workspace/astra-sim-tutorials/micro2024/chakra-demo/demo1/traces (main)* $ chakra_generator --num_npus 8
sharon@sharon:~/workspace/astra-sim-tutorials/micro2024/chakra-demo/demo1/traces (main)* $ ll
total 496
drwxr-xr-x 2 sharon sharon  4096 Jun 10 11:37 ./
drwxr-xr-x 3 sharon sharon 40960 Jun 10 11:37 ../
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.0.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.1.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.2.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.3.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.4.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.5.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.6.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_GATHER.7.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_REDUCE.0.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_REDUCE.1.et
-rw-r--r-- 1 sharon sharon    73 Jun 10 11:37 ALL_REDUCE.2.et
        <!-- snip -->

Please let me know if this helped.

Sharon