Anyone have best practices in mind?

JJasonV

22 comments

LLogan M

Are you using poetry or uv ? Managing project deps with a pyproject.toml and lockfiles is the way to go

JJasonV

poetry

JJasonV

I just tried an update and everything now pretty much conflicts w/everything else.

JJasonV

I have built a monorepo, so there's a lot of dependencies, unfortunately.

LLogan M

dang -- monorepos are hard 😅 In general python kind of sucks at this

JJasonV

Yeah. I'm staring at tons of ERT:

Attachment

JJasonV

... and going in circles.

LLogan M

wow thats hard to read lol

Do you have huggingface-hub explicitly in your deps?

LLogan M

HuggingFaceLLM has these deps

Plain Text

python = ">=3.8.1,<4.0"
huggingface-hub = "^0.23.0"
torch = "^2.1.2"
text-generation = "^0.7.0"
llama-index-core = "^0.11.0"

LLogan M

seems like that might be the cause of the issue?

JJasonV

I do, yes.

JJasonV

Well, I have this:

huggingface-hub = {version = "^0.23.0", extras = ["inference"]}

JJasonV

LOL.

Today I refactored my entire codebase, added FastAPI and put my inferencing behind an API, added docker-compose -- but the thing I've spent the most time on is poetry. 🙂

JJasonV

Oh, and the cursor.com app is fantastic.

LLogan M

hmmm, something is requesting huggingface-hub>=0.24.0,<0.25.0 -- I am struggling to see where this requirement is coming from though

JJasonV

I may have just solved it. Tryiing to build the image now.

JJasonV

I actually have a demoable backed now.

JJasonV

Which is amazing.

LLogan M

amazing! 💪

JJasonV

Sweet. It built. Now, will it run? 🙂

JJasonV

Interesting..

Plain Text

A new version of the following files was downloaded from https://huggingface.co/Alibaba-NLP/new-impl:
- configuration.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
A new version of the following files was downloaded from https://huggingface.co/Alibaba-NLP/new-impl:
- modeling.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.

JJasonV

It works. Now I have a different issue to resolve. Thanks as always.

Add a reply

Find answers from the community

Anyone have best practices in mind?