Hi everyone, Soham Bhowal here. I'm graduating with my master's degree in computer science from ASU this year. I'm currently participating in a project working on transformer models for NLP tasks.
I'm trying to use models from the popular HuggingFace open-source library and using the weights from the bert-base-uncased model to instantiate my own transformer model. I'm using the netron framework to analyze the transformer model and its neural network to get the weights, but I'm only able to access the shape of the matrices, and not get any value of the weights.
I would really appreciate it if someone could help me with this, as I'm fairly new to working with transformers, so if you can provide me with any content or insights on how to proceed, please contact me. Feel free to reach out to my email at
bhowa...@gmail.com if you can provide any assistance.
Thanks and best regards,
Soham Bhowal