@here I had a conversation with Cam regarding AI usage and costs but he said that he would defer to us. @James Scott I know Jehoshua reached out to you so he could run a test using an llm with your AWS Bedrock account. We are going to be testing and using more LLM/AI tools and I want to make sure we have the proper accounts for billing setup. For example should we have our own Bedrock account to separate costs from James' projects? Can/Should we have a ChatGPT or Anthropic enterprise account? We have Vertex AI in GCP and should we just stick to using that? Please provide your thoughts and recommendations?
i have anthropic, we dont have that set up, but not relying on our aws, azure gcp, anthropic can be used and called cloud agnostic, which would make things a lot simplier, and i can create and manage that, since i already do it for chatgpt, more so i dont like gemini
@James Scott thanks for the input. In vertex (GCP) you can use many different models. I hear you on not wanting to use gemini and I don't want to be locked into one model either. We would be able to use others on vertex but I do think of the bigger named ones OpenAI (ChatGPT) is the main one missing.
Question is it worth having an separate enterprise ChatGPT account
so the chatgpt account is for the unlimited use of it, but doesn't include api calls, that is separate billing, however your use case is different as mine, to be honest trying x amount of models is not really needed models are in the state now where they are interchangeable( except gemini) and i dont want to be locked into leveraging gcp credentials and or gcp as a whole it should either be anthropic and or chatgpt outside of the gcp environment as well as the cost factor of using it in gcp where its multiple cost for the same model.
I agree with the interchangeability. We don’t need to use the built in vertex part of GCP but regardless that is where we will host and run any code regardless
Not a problem to just call the outside api in the code
I am already playing around anthropic with a free account right now making api calls
If anthropic is one we want to go with we will just need to create an enterprise account. I will need about 5 licenses.
I can create that nick that’s one I honestly wanna go with too
@James Scott have you seen that you can only fine tune in AWS with Anthropic?
@Nicholas McFadden we should set up a call on this on monday!
*Thread Reply:* Please advise of late afternoon options here
McFadden, how's the notetaker situation?
https://app.fireflies.ai/view/AI-Enterprise-Accounts::01JYEZ7F99PEM87K8EM1Y4AR10
I guess I have been paying for the Pro account personally since July 2024. How should I get reimbursed for this cost and how do I get into an enterprise account or usage of a company card moving forward?