MAINT Removed all poetry stuff

[adam2392]

Changes proposed in this pull request:

• Remove the poetry based installation as its super buggy and hard to maintain

Before submitting

• I've read and followed all steps in the Making a pull request
  section of the CONTRIBUTING docs.
• I've updated or added any relevant docstrings following the syntax described in the
  Writing docstrings section of the CONTRIBUTING docs.
• If this PR fixes a bug, I've added a test that will fail without my fix.
• If this PR adds a new feature, I've added tests that sufficiently cover my new functionality.
• I have added a changelog entry succintly describing the change in this PR in the whats_new relevant version document.

After submitting

• All GitHub Actions jobs for my pull request have passed.