Missing Export for Pinecone DB

[JonahElbaz]

Seems like an export is missing to use Pinecone DB

ts-node src/ai
Error: Package subpath './dist/vectorDb/pinecone-db' is not defined by "exports" in /

Same with cache

Error: Package subpath './dist/cache/lmdb-cache' is not defined by "exports" 

Code

    const ragApplication = await new RAGApplicationBuilder()
      .setModel(new HuggingFace({ modelName: 'mistralai/Mixtral-8x7B-v0.1' }))
      .setVectorDb(new PineconeDb({
        projectName: 'test',
        namespace: 'dev',
        indexSpec: {
          pod: {
            podType: 'p1.x1',
            environment: 'us-east1-gcp',
          },
        },
      }))
      .setCache(new LmdbCache({ path: path.resolve('./cache') }))

      .addLoader(new SitemapLoader({ url: 'https://tesla-info.com/sitemap.xml' }))
      .setTemperature(0.01)
      .setSearchResultCount(100)
      .build();

The imports are structured like this (auto imported)

import { HuggingFace, RAGApplicationBuilder, SitemapLoader } from '@llm-tools/embedjs';

import { PineconeDb } from '@llm-tools/embedjs/dist/vectorDb/pinecone-db';
import { LmdbCache } from '@llm-tools/embedjs/dist/cache/lmdb-cache'

Partial Package.json

  "dependencies": {
    "@llm-tools/embedjs": "^0.0.67",
    "@mistralai/mistralai": "^0.1.3",
    "@pinecone-database/pinecone": "^2.2.0",

Let me know if you need more information to reproduce!

[JonahElbaz]

Resolved by looking at the exports in package.json and altering the import. That being said, Typescript won't accept the import so I need to @ts-ignore it

// @ts-ignore
import { PineconeDb } from '@llm-tools/embedjs/vectorDb/pinecone';
// @ts-ignore
import { LmdbCache } from '@llm-tools/embedjs/cache/lmdb'

Otherwise I get
TS2307: Cannot find module @llm-tools/embedjs/cache/lmdb or its corresponding type declarations.

[adhityan]

This should not be the case. Look at the sample project written in TS -

EmbedJS Slack Bot

I have updated the documentation to make it clear what the import paths should be. For your TS error, could you share with me your tsconfig.json file and node version?

[JonahElbaz]

Thanks for updating the documentation! Will definitely help others with future debugging if needed.

It's worth noting i'm in a monorepo so there might be an issue with that?

Heres my tsconfig (just using one from another project, so nothing really intentionally configured)

{
  "compilerOptions": {
    "module": "commonjs",
    "rootDir": ".",
    "declaration": true,
    "removeComments": true,
    "emitDecoratorMetadata": true,
    "experimentalDecorators": true,
    "allowSyntheticDefaultImports": true,
    "esModuleInterop": true,
    "target": "es2020",
    "sourceMap": true,
    "outDir": "./dist",
    "baseUrl": "./",
    "incremental": true,
    "skipLibCheck": true,
    "strictNullChecks": false,
    "noImplicitAny": false,
    "strictBindCallApply": false,
    "forceConsistentCasingInFileNames": false,
    "noFallthroughCasesInSwitch": false,
    "allowJs": true
  },
  "include": [
    "src/**/*",
    "libs/**/*"
  ],
  "exclude": ["node_modules"]
}

Node Version: 20.12.0

[adhityan]

Thanks for sharing the tsconfig. Did this ever work for you since then? I haven't tested the library with monorepos yet but I suppose I can take a look - but it will take a bit.

[adhityan]

I am closing this issue for now, feel free to reopen it if issue persists. I am planning to move the library itself to a monorepo setup in some time, this should make things easier I suppose.