partial alias/mapping between a container and the model being used

[benoitf]

Issue Description

if I use RamaLama on the host and it starts a container with ramalama run ollama://tinyllama:latest I have

ai.ramalama.model: ollama://tinyllama:latest

so I know which model is used if I compare with the value of ramalama model list command

but if I use ramalama serve tinyllama the value is ai.ramalama.model: tinyllama

so it contains the value I provided so it's difficult/impossible to map the container to the original model

I would expect to see ollama://tinyllama:latest as well for ai.ramalama.model

in container mode, there is an alias being added but the alias is not the fully qualified model name as well
#1009

Steps to reproduce the issue

start models using shortnames or a subpart
or use the CLI container

Describe the results you received

different format of ai.ramalama.model

Describe the results you expected

I expect to always see one of the name returned by ramalama list

ramalama info output

0.7.5 / macOS

Upstream Latest Release

Yes

Additional environment details

No response

Additional information

No response

[rhatdan]

We do translate if we have the name expanded by shortnames, but if ollama expands it we don't.

@ericcurtin Do you know if there is an easy way to figure out tinylama=ollama://tinyllama:latest?

I guess we could just check if the name has

[rhatdan]

We could decorate the shortname our self with TRANSPORT://model:TAG, if we don't see TRANSPORT or TAG specified, but in some cases doesn't ollama translate tiny->tinyllama.

[ericcurtin]

I guess:

ramalama model list == ramalama list

playing with docker I guess 😄

I think ramalama list/ls is fine, we don't really do reverse-shortname resolution though (to display the shortname version). Should we? What does podman do here?

[ericcurtin]

@ericcurtin Do you know if there is an easy way to figure out tinylama=ollama://tinyllama:latest?

It wouldn't be that hard to do a reverse lookup if we wanted to.

[benoitf]

The idea behind this is: How to get the model id from 'model list' command when I have a container running

So no change expected on the list command, but on the annotation/label applied on the container to have as model name the FQN model, the one we can get from 'list' command

It's to be able to know which containers are related to a given model or from a model, what are the containers using that model.

[rhatdan]

I agree with @benoitf here, it would be nice to have this label match the FQN of the pulled model. The question is how easy is this to get with ollama short names.

[rhatdan]

Podman does not list shortnames after the fact. Only reports the full name.