Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#8114: Move softplus to ttnn c++ #8366

Merged
merged 2 commits into from
May 13, 2024
Merged

Conversation

ayerofieiev-tt
Copy link
Member

Moving Softplus (#8114) as part of #5389

Switched from TTL to TTNN binding
Registered softplus as an operation in ttnn C++, bound to python
Moved from activation module to unary
Beta Value and Threshold, as any optional argument, now have to be used by name
Not relying on ttl.tensor.softplus anymore

C++ implementation of softplus currently only supports 4D shapes
I now unsqueeze input to 4D and reshape result back to the original shape.
This required to include ttnn from eager, but thats is aligned with out ongoing effort to merge the two;

Thanks to @arakhmati who basically guided me by hand here!

@davorchap
Copy link
Collaborator

Nice!

Copy link
Contributor

@arakhmati arakhmati left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ayerofieiev-tt ayerofieiev-tt force-pushed the ay/issue-8114-softplus branch 4 times, most recently from 9d8a34e to 9911688 Compare May 10, 2024 20:42
@ayerofieiev-tt ayerofieiev-tt requested a review from tt-rkim as a code owner May 13, 2024 19:30
ayerofieiev-tt and others added 2 commits May 13, 2024 13:11
… tt_dnn and put it as a dependency for tt_eager/tensor, as you could've seen this error when doing make build && make tests
@ayerofieiev-tt ayerofieiev-tt force-pushed the ay/issue-8114-softplus branch from cd62a10 to 26e390d Compare May 13, 2024 20:11
@ayerofieiev-tt ayerofieiev-tt merged commit 37862d7 into main May 13, 2024
5 checks passed
@ayerofieiev-tt ayerofieiev-tt deleted the ay/issue-8114-softplus branch May 13, 2024 22:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants