Josh Josue (jjosue@shield-legal.com)
2025-01-14 14:05:35

Currently waiting on Google's Compose to form my env to use on my Vertex cronjob

Josh Josue (jjosue@shield-legal.com)
2025-01-14 15:39:53

Waiting on the 2PM scheduled cronjob of VertexAI

Josh Josue (jjosue@shield-legal.com)
2025-01-14 16:26:15

TODO: combinedcsvfile value needs to be changed to "../'drugadverseeventdatacombined_datasets.csv"

Josh Josue (jjosue@shield-legal.com)
2025-03-04 16:10:10

add unit tests for chunkified_get_case_entries_for_each_brand_name that checks if chunk_data resets properly

Josh Josue (jjosue@shield-legal.com)
2025-03-07 13:04:53

(When you get a moment, I'd like to discuss my solution with you and confirm that it doesnt compromise the training process)

My code finished after 30min, upserted 17,729 entries to integ_test_integ_test_adverse_events_ranking_logs .The number of entries matches the count for brand_names without cases

Josh Josue (jjosue@shield-legal.com)
2025-03-10 18:55:07

ssh-keygen -t rsa -f gcp-shield-legal -C dev-cronjob -b 2048

Josh Josue (jjosue@shield-legal.com)
2025-03-17 09:53:13

https://github.com/kestra-io/kestra

Josh Josue (jjosue@shield-legal.com)
2025-03-24 20:56:05

// Input was from my own integ_test_data_partial.csv // response from bedrock api call using clincial_extraction.ipynb bedrock api res: <response> { "results_conclusions": "SH-SY5Y-derived neurons express functional GR and MR, allowing the study of corticosteroid-induced transcription. Cortisol, dexamethasone, and aldosterone induced similar transcriptomic effects. Spironolactone mildly attenuated dexamethasone effects in some genes. Transcriptomic alterations were concordant with iPSC-derived neurons. Gene expression in these neurons showed stronger negative correlations with PTSD signatures than MDD signatures in postmortem brain samples.", "score_results": [], "injury": "Post-traumatic stress disorder (PTSD) and major depressive disorder (MDD)", "remedy_type": "in vitro model", "remedy_name": "SH-SY5Y-derived neurons", "remedy_length": "Not specified", "icd_chapter": "V: Mental and behavioural disorders", "icd_code": "F43", "icd10_name": "Reaction to severe stress, and adjustment disorders", "risk_assessment": "neutral" }

Josh Josue (jjosue@shield-legal.com)
2025-03-24 21:04:39

// my bedrock api response: -- bedrock api res: {"ResponseMetadata": {"RequestId": "4c7d4758-6cdb-4e83-8c97-51c0380a59e3", "HTTPStatusCode": 200, "HTTPHeaders": {"date": "Tue, 25 Mar 2025 01:59:54 GMT", "content-type": "application/json", "content-length": "1008", "connection": "keep-alive", "x-amzn-requestid": "4c7d4758-6cdb-4e83-8c97-51c0380a59e3", "x-amzn-bedrock-invocation-latency": "5234", "x-amzn-bedrock-output-token-count": "219", "x-amzn-bedrock-input-token-count": "11364"}, "RetryAttempts": 0}, "contentType": "application/json", "body": "eyJpZCI6Im1zZ19iZHJrXzAxWGZMcjNuUHA2MVNDOWpSb2lMZjlITCIsInR5cGUiOiJtZXNzYWdlIiwicm9sZSI6ImFzc2lzdGFudCIsIm1vZGVsIjoiY2xhdWRlLTMtNS1zb25uZXQtMjAyNDA2MjAiLCJjb250ZW50IjpbeyJ0eXBlIjoidGV4dCIsInRleHQiOiI8cmVzcG9uc2U+XG57XG4gIFwicmVzdWx0c19jb25jbHVzaW9uc1wiOiBcIlRoZSBjYXNlIHJlcG9ydCBkZW1vbnN0cmF0ZXMgdGhlIGVmZmVjdGl2ZW5lc3Mgb2YgQlJBRiBhbmQgTUVLIGluaGliaXRvcnMgKGRhYnJhZmVuaWIgYW5kIHRyYW1ldGluaWIpIGluIHRyZWF0aW5nIHBsZW9tb3JwaGljIGNhcmNpbm9tYSB3aXRoIEJSQUYgbXV0YXRpb25zLCBldmVuIGluIGVsZGVybHkgcGF0aWVudHMuIFRoZSB0cmVhdG1lbnQgbGVkIHRvIHNpZ25pZmljYW50IGltcHJvdmVtZW50IGluIHN5bXB0b21zIGFuZCByYWRpb2xvZ2ljYWwgZmluZGluZ3MsIG1haW50YWluaW5nIHRoZSBwYXRpZW50J3MgY29uZGl0aW9uIGZvciBhYm91dCBuaW5lIG1vbnRocy5cIixcbiAgXCJzY29yZV9yZXN1bHRzXCI6IFtdLFxuICBcImluanVyeVwiOiBcIlBsZW9tb3JwaGljIGNhcmNpbm9tYSBvZiB0aGUgbHVuZ1wiLFxuICBcInJlbWVkeV90eXBlXCI6IFwibWVkaWNhdGlvblwiLFxuICBcInJlbWVkeV9uYW1lXCI6IFwiRGFicmFmZW5pYiBhbmQgVHJhbWV0aW5pYlwiLFxuICBcInJlbWVkeV9sZW5ndGhcIjogXCIxMSBtb250aHNcIixcbiAgXCJpY2RfY2hhcHRlclwiOiBcIklJOiBOZW9wbGFzbXNcIixcbiAgXCJpY2RfY29kZVwiOiBcIkMzNFwiLFxuICBcImljZDEwX25hbWVcIjogXCJNYWxpZ25hbnQgbmVvcGxhc20gb2YgYnJvbmNodXMgYW5kIGx1bmdcIixcbiAgXCJyaXNrX2Fzc2Vzc21lbnRcIjogXCJkZWNyZWFzZVwiXG59XG48L3Jlc3BvbnNlPiJ9XSwic3RvcF9yZWFzb24iOiJlbmRfdHVybiIsInN0b3Bfc2VxdWVuY2UiOm51bGwsInVzYWdlIjp7ImlucHV0X3Rva2VucyI6MTEzNjQsIm91dHB1dF90b2tlbnMiOjIxOX19"} something fishy going on hmmm... why is it so different?

Josh Josue (jjosue@shield-legal.com)
2025-03-24 21:42:47

// the notebook's values in the validator() -- cls: &lt;class '__main__.QAResponseModel2'&gt; -- values: {'results_conclusions': "Loss of AKR1D1 promotes accumulation of iso-LCA through gut microbiome dysregulation, im

Josh Josue (jjosue@shield-legal.com)
2025-03-24 21:43:23

// my values in validator(): !!! values: ValidationInfo(config={'title': 'QAResponseModel2', 'extra_fields_behavior': 'allow'}, context=None, data=None, field_name=None)

Josh Josue (jjosue@shield-legal.com)
2025-03-26 19:32:10
image.png
Josh Josue (jjosue@shield-legal.com)
2025-03-26 22:26:26

are these valid unscaled numbers?

image.png
Josh Josue (jjosue@shield-legal.com)
2025-03-27 19:58:10

I've setup an integration test with James's notebook code - but I need his help to verify that it's a valid test (bcuz the data seems good but it errors out for nan data)

Josh Josue (jjosue@shield-legal.com)
2025-03-27 19:59:20

i need faster turnarounds to debug properly

Josh Josue (jjosue@shield-legal.com)
2025-03-27 21:28:45

I understand the overall goal of the rank being joined BUT • why does the ranknet result in -1 ranks for the sample data? • why does the ranknet result in 87k results (sample data is just 1k)?

Josh Josue (jjosue@shield-legal.com)
2025-03-31 15:39:15
image.png
Josh Josue (jjosue@shield-legal.com)
2025-04-01 01:28:21

/Remind me tomorrow at 8:30AM TODO: Double check step8’s geticdretainedlabelsdata() function and how many times the notebook code invokes it

Josh Josue (jjosue@shield-legal.com)
2025-04-02 10:30:08
image.png
Josh Josue (jjosue@shield-legal.com)
2025-04-15 12:12:05
.env
Josh Josue (jjosue@shield-legal.com)
2025-04-15 19:15:38

josh123!

Josh Josue (jjosue@shield-legal.com)
2025-04-15 19:15:51

dev@shield-legal.com

Josh Josue (jjosue@shield-legal.com)
2025-04-16 11:09:44
image.png
Josh Josue (jjosue@shield-legal.com)
2025-04-24 14:28:03

Current Concerns: • Step 9 integration test on input/output data length comparisons still FAILS • Dashboard rank table: the query is weird bcuz source table has rank1’s but the table has no rank 1’s displayed

Josh Josue (jjosue@shield-legal.com)
2025-05-14 16:18:48

SELECT ** FROM `tort-intake-professionals.lr_data.lead` as a JOIN `tort-intake-professionals.lr_data.lead_question` as b ON a.id = b.leadid WHERE a.id = 678018

Josh Josue (jjosue@shield-legal.com)
2025-05-14 16:19:06

username: <a href="mailto:jjosue@shield-legal.com">jjosue@shield-legal.com</a> pw: lMZYWD35@&amp; <a href="http://tortintakeprofessionals.lawruler.com">tortintakeprofessionals.lawruler.com</a>

Josh Josue (jjosue@shield-legal.com)
2025-05-16 16:01:16
output_1704.xlsx
Josh Josue (jjosue@shield-legal.com)
2025-05-18 20:39:21
Untitled
Josh Josue (jjosue@shield-legal.com)
2025-05-28 16:08:53
reports.py
Josh Josue (jjosue@shield-legal.com)
2025-05-28 18:47:09
ids_not_found.txt
Josh Josue (jjosue@shield-legal.com)
2025-05-30 15:36:06
image.png
Josh Josue (jjosue@shield-legal.com)
2025-06-10 15:19:39

Question Custom ID Mapping Mailing Address 2 &lt;&lt;Default9&gt;&gt; Contact/Address/0/Address2 State &lt;&lt;Default11&gt;&gt; 11 Middle Name &lt;&lt;Default3&gt;&gt; Contact/MiddleName Date of Birth (Value must be a date) &lt;&lt;Default23&gt;&gt; 23 Marital Status &lt;&lt;Default89&gt;&gt; Contact/MaritalStatus Primary Email &lt;&lt;Default16&gt;&gt; 16 First Name &lt;&lt;Default2&gt;&gt; Contact/Firstname Suffix &lt;&lt;Default5&gt;&gt; Contact/Suffix Business Phone &lt;&lt;Default14&gt;&gt; Contact/WorkPhone Sex (Value must be M or F) &lt;&lt;Default22&gt;&gt; Contact/Gender Date of Death (Value must be a date) &lt;&lt;Default91&gt;&gt; Contact/DateOfDeath City &lt;&lt;Default10&gt;&gt; 10 Zip &lt;&lt;Default12&gt;&gt; 12 Full Name &lt;&lt;Default1&gt;&gt; 1 Last Name &lt;&lt;Default4&gt;&gt; Contact/Lastname Mailing Address 1 &lt;&lt;Default8&gt;&gt; Contact/Address/0/Address1 Home Phone &lt;&lt;Default13&gt;&gt; Contact/HomePhone Cell Phone &lt;&lt;Default15&gt;&gt; 15 SSN# &lt;&lt;Default20&gt;&gt; 20

Josh Josue (jjosue@shield-legal.com)
2025-06-10 16:25:57

Audit files with default columns be like: 2025-06-10 14:22:18,224 - INFO - Found lawrulerfield: 23 for question: Injured party's date of birth: - [23]

Josh Josue (jjosue@shield-legal.com)
2025-06-10 16:30:55

POI: audit_team_data_service.convert_audit_question_id_to_integrations_friendly_format()

Josh Josue (jjosue@shield-legal.com)
2025-06-10 16:31:24

POI: audit_team_data_service.convert_audit_question_id_to_integrations_friendly_format()

Josh Josue (jjosue@shield-legal.com)
2025-06-10 16:38:42

Printout the question_and_ids from defensureupdategcpentrywithanynewaudit_data()`

Josh Josue (jjosue@shield-legal.com)
2025-06-16 15:48:24

CHATGPT_API_KEY=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

Josh Josue (jjosue@shield-legal.com)
2025-06-17 00:54:45

this is a problem if q_id is c-91 and it comes across c-9123 first def _search_for_custom_q_id_and_answer(self, q_id: str, gcp_entry: dict[str, str]) -&gt; str: res = "" for gcp_q_verbiage in gcp_entry: if q_id in gcp_q_verbiage: res = gcp_q_verbiage break return res

Josh Josue (jjosue@shield-legal.com)
2025-06-17 17:04:38

1 is from the master spreadsheet that Devon has

Josh Josue (jjosue@shield-legal.com)
2025-06-20 13:30:42

Is the spreadsheet the source of truth as to whether or not the SA occurred during strip search?

Nick said they’ll work with Doug for a blanket statement for 6,7,8. If spreadsheet says yes, put blanket statement

Josh Josue (jjosue@shield-legal.com)
2025-06-23 12:40:09

If #4 cant be derived from the docs:

Ask Abe if #4 question about “why” will have blanket statement

Where do i get more sample docs to run thru tests?

Josh Josue (jjosue@shield-legal.com)
2025-06-23 13:38:11

Verified that field 4 is NOT guaranteed to answer the "why?"

Josh Josue (jjosue@shield-legal.com)
2025-06-24 16:00:34

left to create tests for: 248570, 251474, 252113

Josh Josue (jjosue@shield-legal.com)
2025-08-05 13:54:11
bruce_wayne_para.txt
Josh Josue (jjosue@shield-legal.com)
2025-08-05 16:20:44

https://nlp.stanford.edu/projects/glove/

nlp.stanford.edu
GloVe: Global Vectors for Word Representation
GloVe: Global Vectors for Word Representation
Original URL: https://nlp.stanford.edu/projects/glove/
Josh Josue (jjosue@shield-legal.com)
2025-08-06 15:33:36
openai.py
Josh Josue (jjosue@shield-legal.com)
2025-08-06 16:03:15

https://huggingface.co/docs/inference-providers/en/guides/structured-output

huggingface.co
Structured Outputs with Inference Providers
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Original URL: https://huggingface.co/docs/inference-providers/en/guides/structured-output
Josh Josue (jjosue@shield-legal.com)
2025-08-07 12:21:18

https://www.youtube.com/watch?v=Ok8O_QnrSBI

YouTube
Jie Jenn (https://www.youtube.com/@jiejenn)
Upload Files To One Drive Using Microsoft Graph API In Python
Original URL: https://www.youtube.com/watch?v=Ok8O_QnrSBI
Josh Josue (jjosue@shield-legal.com)
2025-08-20 15:52:01
mail_merger_v0_3_3.zip