Quint Underwood (quint.johnson@gmail.com)
2024-01-07 18:37:24

Hey Ryan--I found the issue preventing TIP from ingesting the Form 95 rawstatusreport entries: we parse raw_status_report.type_of_case to get 4 fields in financial_log table so it's expecting one of the two following formats: case_type_retainer_code - client - co_counsel - source or case_type_retainer_code - client - source

Quint Underwood (quint.johnson@gmail.com)
2024-01-07 18:39:28

I'm not sure of your workflow/purpose of Form 95, but I can edit the lambda to set those financial_log fields to be blank if they can't be extracted from the raw_status_report.type_of_case field

Ryan (ryan@themedialab.agency)
2024-01-07 18:52:13

I can update the name to all four fields in LR, but can you make these strings out into log table:

Case Review% And Secondary Interview - Final

Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:00:11

*Thread Reply:* I'm not sure I follow--what should I do with those two strings?

Ryan (ryan@themedialab.agency)
2024-01-07 19:01:12

*Thread Reply:* Make those the same as Signed e-Sign% so they are put into the fin_log table.

Ryan (ryan@themedialab.agency)
2024-01-07 19:02:33

*Thread Reply:* You can make it Secondary Interview - Final with no wildcard.

Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:12:49

*Thread Reply:* Still not tracking--which table, which fields? And presumably you want me to make changes to the 271 entries from your SQL query (in raw_status_report)?

Ryan (ryan@themedialab.agency)
2024-01-07 19:15:38

*Thread Reply:* @Quint Underwood

audio_message.webm
Ryan (ryan@themedialab.agency)
2024-01-07 19:16:19

*Thread Reply:*

audio_message.webm
Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:17:52

*Thread Reply:* Ah I'm with you, thanks

Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:17:57

*Thread Reply:* Yep I'll make those changes right now

Ryan (ryan@themedialab.agency)
2024-01-07 19:17:59

*Thread Reply:* You can see my "hack" method to get them in there now that I now it was the Case Type name:

image.png
Ryan (ryan@themedialab.agency)
2024-01-07 19:18:51

*Thread Reply:* I run SQL every morning to change Case Reviews and Secondary Interviews to contain "Signed e-Sign" in rawstatustable, so this change is the big fix.

Ryan (ryan@themedialab.agency)
2024-01-07 18:52:29

I’ll do the table name update now.

Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:42:19

I added checks for those two additional current_status strings/patterns:

Screenshot 2024-01-07 at 5.38.19 PM.png
Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:43:08

About to push code--FYI it will (try to) process 4588 rows from rawstatusreport

Ryan (ryan@themedialab.agency)
2024-01-07 19:43:44

@Quint Underwood , sounds good. I’ll clean up dashboards after you confirm it’s run.

Quint Underwood (quint.johnson@gmail.com)
2024-01-07 19:56:20

Changes just deployed so we should be good to go

Ryan (ryan@themedialab.agency)
2024-01-08 11:47:52

Excellent, we'll monitor.

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 19:27:54

I looked through the Lambda logs and didn't see anything obviously wrong, but I can do a deeper dive this evening if you guys haven't identified the root cause yet?

Ryan (ryan@themedialab.agency)
2024-01-10 19:28:40

Man, I checked Camp Lejeune contracts active in Leadspedia and LDP Verticals table in DBMaster, and it all seems fine.

Ryan (ryan@themedialab.agency)
2024-01-10 19:29:01

No fails in Zapier, let me check the data@ email and make sure they are getting put into Inbox and not somewhere else maybe?

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 19:31:34

*Thread Reply:* Yeah that would be good. If they are getting into the email, I'm guessing it's the Lambda that's causing issues...

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 19:34:48

*Thread Reply:* The TIP slack alerts was one of Devin's microservices so I don't know all of its (potential) quirks, but once we find the failure I can get it fixed

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 19:32:46

And regarding support contract--I can put together an ongoing support SOW and send it your way. I presume that's the best way to structure this?

Ryan (ryan@themedialab.agency)
2024-01-10 19:35:15

Let me check one thing on this <#C03GKEAN2SD|camp-lejeune> issue

👍 Quint Underwood
Ryan (ryan@themedialab.agency)
2024-01-10 19:37:43

I found out why, it's not US.

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 19:48:57

*Thread Reply:* ahh... glad it's solved then

Ryan (ryan@themedialab.agency)
2024-01-10 19:37:48

Every lead has been a referral.

Ryan (ryan@themedialab.agency)
2024-01-10 19:38:05

How much time did you spend on the Lambda code change?

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 19:48:22

*Thread Reply:* 3 hours

Ryan (ryan@themedialab.agency)
2024-01-10 19:49:13

*Thread Reply:* Send me an invoice at $200 per hour made out to Tort Intake Professionals not Shield Legal.

👍 Quint Underwood
Ryan (ryan@themedialab.agency)
2024-01-10 19:49:37

We’ll confirm if I am wrong , cannot check until tomorrow

Quint Underwood (quint.johnson@gmail.com)
2024-01-10 21:44:11

Here's that invoice (bank details are the same on my side)

INV-000002.pdf
☝️:skin_tone_4: Ryan
Ryan (ryan@themedialab.agency)
2024-01-11 13:38:37

@Quint Underwood, sent it to Tony and Debbie to pay.

Quint Underwood (quint.johnson@gmail.com)
2024-01-11 13:40:56

*Thread Reply:* Great, thanks Ryan--appreciate it

Ryan (ryan@themedialab.agency)
2024-01-16 11:16:58

@Quint Underwood, open another invoice and let me know how long to get TIPGenerateFinLogPY311 to run on a 4 AM, 8:15 AM, 12:15 PM, and 3:15 PM each day please.

Quint Underwood (quint.johnson@gmail.com)
2024-01-16 11:41:17

*Thread Reply:* Hey Ryan--will do. I'll take a look at it tonight & lyk if I have other questions

Ryan (ryan@themedialab.agency)
2024-01-16 11:42:41

*Thread Reply:* Ty @Quint Underwood, for perspective.

👍 Quint Underwood
Quint Underwood (quint.johnson@gmail.com)
2024-01-18 11:53:00

*Thread Reply:* @Ryan Question here: you have 8:15PM, is that correct? Or do you mean 8:15AM?

Ryan (ryan@themedialab.agency)
2024-01-18 11:53:22

*Thread Reply:* AM, exude the typo

Ryan (ryan@themedialab.agency)
2024-01-18 11:53:31

*Thread Reply:* Excuse

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 11:53:47

*Thread Reply:* 👍

Quint Underwood (quint.johnson@gmail.com)
2024-01-16 11:45:58

We've made it to the big screen haha

Ryan (ryan@themedialab.agency)
2024-01-16 11:46:03

LOL

Ryan (ryan@themedialab.agency)
2024-01-16 11:46:04

Yerp!

Quint Underwood (quint.johnson@gmail.com)
2024-01-16 23:57:34

So currently you manually run TIP-generate-fin-log, correct? (At some point in the day after the call reports & status reports have been processed)

Quint Underwood (quint.johnson@gmail.com)
2024-01-16 23:59:54

I think the best strategy is to use AWS Step Functions to automatically run Generate Financial Log after the raw status report & raw call report have been processed. With this approach, you shouldn't be tied to any particular timing and the entire pipeline will run from beginning to end whenever call reports & status reports are uploaded to S3 bucket. So you should be able to freely adjust the report timing in your dialing software without changing things in AWS

Amazon Web Services, Inc.
Workflow Orchestration - AWS Step Functions - AWS
AWS Step Functions lets you orchestrate multiple AWS services into serverless workflows so that you can build and update applications quickly.
Original URL: https://aws.amazon.com/step-functions/
Quint Underwood (quint.johnson@gmail.com)
2024-01-17 00:02:31

I haven't used AWS Step Functions before, but I don't expect it to be too difficult. I'd say ~10 hours

Quint Underwood (quint.johnson@gmail.com)
2024-01-17 00:05:06

I can also just add the 4x daily triggers you mentioned as we currently do with the daily leads report, should only be an hour or so (assuming I'm not overlooking something)

Quint Underwood (quint.johnson@gmail.com)
2024-01-17 00:05:17

Up to you which you'd prefer

Ryan (ryan@themedialab.agency)
2024-01-17 08:29:49

I prefer the easier and faster way, what’s the difference in the set up?

Ryan (ryan@themedialab.agency)
2024-01-17 08:31:09

@Quint Underwood , but if the step functions is more robust, will be using this method probably for another six months to a year. Again, I’ll lean on you to make it the most stable and robust solution. I’m gonna bill the tip team for your hours.

Ryan (ryan@themedialab.agency)
2024-01-18 09:02:48

@Quint Underwood Morning. Any ups as re in the lambda scheduling

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 11:23:03

Hey Ryan--so after thinking it over, let's keep it simple for now and just add static timers. If in the future your needs change dramatically, we can look into more robust options but this will be easier and faster for now

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 11:23:05

I'll set that up right now.

Ryan (ryan@themedialab.agency)
2024-01-18 11:23:14

Thank you.

Ryan (ryan@themedialab.agency)
2024-01-18 11:31:53

@Quint Underwood, also make sure the new PY311 with the added Status checks is being called on the 4AM as well, I noticed at 8AM it was brining in new stuff before I setup the LawRuler status / call report emails.

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:16:15

*Thread Reply:* The triggers are all on the same Py311 Generate financial log lambda, so it will be called at 4AM. If something's still not being processed correctly after we have the automated triggers in place, lmk and I can help debug it further?

Ryan (ryan@themedialab.agency)
2024-01-18 12:16:34

*Thread Reply:* Sure!

Ryan (ryan@themedialab.agency)
2024-01-18 12:16:35

*Thread Reply:* Ty

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:12:08

I just enabled triggers for 4:00AM, 8:15AM, 12:15PM, 3:15PM

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:26:47

Since cron is UTC and daylight savings always shifts the triggers by 1 hour each direction, I created 4 additional triggers that are the same times but for daylight saving time. These are currently disabled

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:27:42

Here are the winter triggers (PST), currently ENABLED:

Screenshot 2024-01-18 at 10.27.05 AM.png
Ryan (ryan@themedialab.agency)
2024-01-18 12:28:06

Can you send me a video on how to swap from login to update?

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:28:53

*Thread Reply:* Yep

Ryan (ryan@themedialab.agency)
2024-01-18 12:30:05

*Thread Reply:* Ty

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:30:34

*Thread Reply:* I have a meeting in a few min so will record & send to you afterwards

Ryan (ryan@themedialab.agency)
2024-01-18 12:30:43

*Thread Reply:* Thank you

👍 Quint Underwood
Ryan (ryan@themedialab.agency)
2024-01-18 12:28:07

🙂

Quint Underwood (quint.johnson@gmail.com)
2024-01-18 12:28:18

Here are the summer triggers (PDT), currently DISABLED:

Screenshot 2024-01-18 at 10.28.03 AM.png
✅ Ryan
Quint Underwood (quint.johnson@gmail.com)
2024-01-18 15:10:43

Here's a video showing how to activate/deactivate the triggers

TIP_lambda_triggers_activate.mov
Ryan (ryan@themedialab.agency)
2024-01-18 16:37:53

*Thread Reply:* I'll watch soon but thank you @Quint Underwood

Quint Underwood (quint.johnson@gmail.com)
2024-01-23 14:02:47

Hey Ryan--if it's all right with you, I'll send that latest invoice (so far, 2 hours @ $185) at the end of the month in case there's any more support between now and then. Cut down on the admin effort a little bit 🙂

Ryan (ryan@themedialab.agency)
2024-01-23 14:16:31

@Quint Underwood, that sounds good to me. Thank you.

👍 Quint Underwood
Ryan (ryan@themedialab.agency)
2024-01-23 15:49:59

@Quint Underwood, before you send, got another update to Fin_Log

Ryan (ryan@themedialab.agency)
2024-01-23 15:50:03

Want to call me real quick to discuss this change?

Ryan (ryan@themedialab.agency)
2024-01-23 15:50:08

Ryan (ryan@themedialab.agency)
2024-01-23 15:51:10

It's a fairly simple change @Quint Underwood, but easier to talk over...

Quint Underwood (quint.johnson@gmail.com)
2024-01-23 15:54:18

Yeah I'll call you, 1 sec..

Ryan (ryan@themedialab.agency)
2024-03-19 12:00:02

Can you check the S3 to Raw Tables lambda logs? The 4AM LawRuler Call & Status report showed up, but it did not seems to get into the raw tables, until I manually did them this morning.

Ryan (ryan@themedialab.agency)
2024-03-19 12:00:04

@Quint Underwood

Ryan (ryan@themedialab.agency)
2024-03-19 12:00:18

Not sure all the lambdas are firing when supposed to or if things timed out

Quint Underwood (quint.johnson@gmail.com)
2024-03-19 13:58:40

Hey @Ryan I can check that later today

Ryan (ryan@themedialab.agency)
2024-03-19 15:45:55

Thank you.

Quint Underwood (quint.johnson@gmail.com)
2024-03-20 17:20:23

I pushed a fix for the issue you ran into yesterday morning, which is a new one--The LP Lead associated with a TIP lead was not actually a sold lead. So when we look up sold lead by LP Lead ID, we don't get anything back, which caused the issue.

Now it will check to make sure the associated LP Lead is actually marked as sold, otherwise the lambda will skip any Leadspedia API calls

👏:skin_tone_4: Ryan
Ryan (ryan@themedialab.agency)
2024-03-20 18:07:07

Thanks quint.

👍 Quint Underwood
Ryan (ryan@themedialab.agency)
2024-04-25 20:18:19

Did that break the whole system then?

Quint Underwood (quint.johnson@gmail.com)
2024-04-25 20:42:18

The incorrect channel mappings? Yeah it did. I'll look into upgrading/consolidating some of the microservices on Sunday as I mentioned--mostly the Leadspedia/Slack ones (not morning financials in this case). I think some architectural changes would help things run faster and reduce the risk of human error in manual mapping stuff...

Ryan (ryan@themedialab.agency)
2024-04-25 20:54:43

Brian should not make that mistake , he’s doing real SQL data engineering but our new data warehouse has n GCP has a lot of ways to send slacks

Quint Underwood (quint.johnson@gmail.com)
2024-08-22 13:50:30

The "datastudio" DB is updating to new CA cert, doing others now

Quint Underwood (quint.johnson@gmail.com)
2024-08-22 13:51:23

Actually I'll verify I can connect via PGadmin first before changing others

Ryan (ryan@themedialab.agency)
2024-08-22 13:51:35

Ok, let me know when SL datastudio is done, I'll retry Fivetran and PGAdmin

Ryan (ryan@themedialab.agency)
2024-08-22 13:52:24

I'm still running SQL in PGAdmin on SL datastudio's dbmaster

Ryan (ryan@themedialab.agency)
2024-08-22 13:54:41

Fivetran re-config test worked @Quint Underwood

Running sync of pipeline now

image.png
👍 Quint Underwood
Quint Underwood (quint.johnson@gmail.com)
2024-08-22 13:56:54

Sweet I'll update others. AWS docs recommend updating the client certs first, but I think it's fine to disregard that in this case

Ryan (ryan@themedialab.agency)
2024-08-22 13:57:45

Great, let me know when TIP DB is done, I can check Fivetran again.

Quint Underwood (quint.johnson@gmail.com)
2024-08-22 14:01:45

All are finished updating certs, but TIP-LS-CORE is still doing some updating..

Ryan (ryan@themedialab.agency)
2024-08-22 14:02:12

Nice, keep your phone close but that wasn't so hard.

👍 Quint Underwood
Quint Underwood (quint.johnson@gmail.com)
2024-08-22 14:09:24

Also FYI, noticed you have these unattached static IPs. Unattached static IPs cost money ($0.005/hour), attached static IPs do not cost anything. Math comes out to $7.20/month for both combined

Screenshot 2024-08-22 at 12.07.41 PM.png
Quint Underwood (quint.johnson@gmail.com)
2024-08-22 14:09:32

Any reason to keep them or should I delete them?

Ryan (ryan@themedialab.agency)
2024-08-22 14:10:33

You can delete them.

Quint Underwood (quint.johnson@gmail.com)
2024-08-22 14:24:07

deleted

Ryan (ryan@themedialab.agency)
2024-08-22 14:27:00

ty

Ryan (ryan@themedialab.agency)
2024-08-22 14:27:22

Think we are good, I'll let you know if anything pops up

👍 Quint Underwood
Ryan (ryan@themedialab.agency)
2024-09-13 14:07:47

URGENT, can you check the logs on this?

Jack Altunyan (https://themedialaboratory.slack.com/team/UFV2Z1J3S)
<p>hey @Ryan AFFF isl command keeps timing out for me. Can you have the dev take a look at it please? Got a ton of spend running here need to make sure this comes smooth. thank you</p>
Slack Conversation
Quint Underwood (quint.johnson@gmail.com)
2024-09-13 14:19:21

Pulling it up

Quint Underwood (quint.johnson@gmail.com)
2024-09-13 14:26:04

Just pushed change to the /isl to use max execution time (15 minutes), and doubled the RAM just in case

Ryan (ryan@themedialab.agency)
2024-09-13 14:27:40

@Quint Underwood, just did a test in #firefoam, you seeing it executing?

Quint Underwood (quint.johnson@gmail.com)
2024-09-13 14:28:19

It probably hasn't finished building yet, typically takes about ~7 minutes. I'm checking though

Ryan (ryan@themedialab.agency)
2024-09-13 14:28:35

ok

Quint Underwood (quint.johnson@gmail.com)
2024-09-16 13:00:50

Hey Ryan, touching base on a few things: • Still have some work to finish on TIP daily financials lambda, and today’s getting chaotic so I sent a reschedule request for today’s meeting for Friday same time—all of Friday (20 Sept) is open for me so feel free to choose time that works • The /isl command started working again Friday evening (timeout issue), but I wouldn’t be surprised if it returns. I think the best long-term fix is to replace the slack get_channels() API call with a database read. I estimate this would be ~15 hours effort, and would help jumpstart the process of updating the remaining Slack slash commands (some rearchitecturing to be faster, more reliable, less manual effort by Brian to update .csv file in Github). We can talk through this more if you like. (We avoided the database read initially in order to keep it simple and avoid scope creep). • If we do any microservice rework, there are a few security best practices I’d recommend implementing. Mainly increasing security of the databases by adding a second layer of authentication for access (bastion/jump host, VPN, etc.).

Ryan (ryan@themedialab.agency)
2024-09-16 13:02:07

@Quint Underwood , sounds good. Let’s talk /isl on that Friday meeting. Can you keep logs up and make sure we try to minimize this?

Ryan (ryan@themedialab.agency)
2024-09-20 11:18:21

I cannot hear you

Ryan (ryan@themedialab.agency)
2024-09-20 11:18:26

It's your side mic

Quint Underwood (quint.johnson@gmail.com)
2024-09-20 11:18:27

sorry just saw

Quint Underwood (quint.johnson@gmail.com)
2024-09-20 11:18:29

let me fix

Quint Underwood (quint.johnson@gmail.com)
2024-09-27 07:35:39

Need to move our SL Lambda TIP to next week (anytime Tuesday works on my end, requested on cal)—managing product release that’s behind schedule & need to focus on that today

👏:skin_tone_4: Ryan
Ryan (ryan@themedialab.agency)
2024-10-08 10:03:34

@Quint Underwood, how you coming on SL Calc Perf and the new ISL command? I'm traveling today and if we are not ready to test these, I can push the meeting.

Quint Underwood (quint.johnson@gmail.com)
2024-10-08 10:35:54

Let's push it--made a ton of progress on /isl and as a byproduct made some headway on database security setup, but still some to go. Friday would be most ideal for me--traveling tomorrow afternoon but could do early meeting (excluding 11-12) if needed. Most of Thursday is booked but could do 9am or ~11:30am. Friday is open all day for me

🙏:skin_tone_4: Ryan
☝️:skin_tone_4: Ryan
Ryan (ryan@themedialab.agency)
2024-10-11 10:29:49

Morning Quint, about to board my plane back to Tulsa. My oldest son got pretty sick so I need to push our Calc_Perf and ISL Slash command review to Monday or Tuesday next week, let me know some times.

Ryan (ryan@themedialab.agency)
2024-10-11 10:29:51

@Quint Underwood

Quint Underwood (quint.johnson@gmail.com)
2024-10-11 10:41:13

Hey @Ryan I'm sorry to hear, hope he recovers quickly

Quint Underwood (quint.johnson@gmail.com)
2024-10-11 10:41:43

And yes of course--my calendar is open all of next Monday so anytime should work. I'm in KC for next few weeks so same TZ as Tulsa, fwiw

Ryan (ryan@themedialab.agency)
2024-10-11 10:42:41

Ty, welcome home. I’ll check Monday for times.

👍 Quint Underwood