Hi James! Thanks for invites to GitHub. Can I also ask you for access to GCP/BigQuery?
I believe I sent that over already but lemme take a look..
Looks like you're on the shield one as well
Oh I can see it now, thanks! You added me on the project level, not the org level. All good, thank you!
Ah- Gotcha. That makes sense. I do not have access to add at the org level
Hi James! It’s not a blocker but if possible - can I ask you to grant me cloudasset.viewer role on the projects? It’s not required but will let me run some checks on the project resources
Sure thing- Looking into adding you on there now-
Just approved for TIP- I'll get you on shield next. Let me know if you need anything else.
By the way, I appreciate the advice earlier. This is my first year as a true data engineer despite doing data science and analytics at my previous company. It's a lot to wrap the mind around, and getting solid advice from more senior engineers is always welcome!
oh sure, designing the proper role-based access control can be pretty complicated and very much depends on the project domain, I’ll be glad to help with that
if the permissions fit into a simple 2d matrix - that is great and the role management could be pretty simple. In some cases it gets more involved though, for instance when you have nested permissions that change over time and depend on the entity you attach the policy to
Especially in multi-tenant systems where a person has role A in project1 and role B in project2 and all those roles are nested via group membership. And we need to pack those roles into a single JWT token with 3rd party SSO. And refresh the token roles when the group membership changes :)
That makes sense. I was thinking of setting it up where each "data set" is a permission, and there are a lot of roles that may touch just one or multiple permissions- then an individual can be assigned multiple roles like in Bigquery.
The way you describe it makes sense, to start with the permissions, rather than the roles the company has
yep-yep, I can tell a lot of scary stories when it was done wrong 🙂 but it is very important to design it properly at the early stages of the project
Hi James! Can I also ask you to grant me roles/serviceusage.serviceUsageConsumer role on the GCP projects? Thank you!
Hey there, let me see if I have access to do so
Hi James! Can you help me understand how you run the integrations with lawfirms? I found the code for some cloud run functions on GitHub but couldn’t find these functions in GCP console
Hey there' So it really depends on each lawfirm as they all have different systems. Our integrations team works hard to try and learn the system for each different client we work with to get their data over to them in a way that makes sense
The real expert on that subject is going to be Dustin Surwill