Slack Export

He is already kinda on one this morning and the deadline is probably shorter than I expected so he may have thought we were working over the weekend on it. So just prepare to really jump on this project. Ask as many questions as you can to understand all of the components.

👍 Josh Josue

Josh Josue (jjosue@shield-legal.com)

2025-06-16 11:43:10

Ok gotcha

Josh Josue (jjosue@shield-legal.com)

2025-06-16 11:43:43

Yea I’m currently working on scraping the sample file still

👍 Nicholas McFadden

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-16 12:54:40

240 Secondary Interview Completed or Secondary Interview Re-Triggered for ACTS-DL-Flatirons Chowchilla. These are the ones with documents uploaded to LawRuler

Chowchilla ACTS DL Flatirons .xlsx

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-16 12:56:01

Abes project description: The litigation has determined that each plaintiff shall file a short form complaint. The format of the document is non-negotiable and must match to what the court ordered in the provided template. The expected values must also match to the expected format from the court provided form because this will be filed with the court. The data may have already been collected by the vss team during secondary interviews however the format of the data is probably incorrect for this document. This project will require data gathering from shield legal's intake and vss secondary interviews and writing scripts to transform the data into the correct fields or alert us to requiring the vss to follow up with a client to get missing data. This project will also require tracking of what has been done v what will be required. As an example of a script i am thinking of....writing an if statement to look at each cell to see if it will answer the question as a yes. Or writing a more in depth if statement to look at three different cells to see if the answer is a yes

Josh Josue (jjosue@shield-legal.com)

2025-06-16 13:43:18

I performed a quick test with ChatGPT using the account James gave me, and it gave me the expected answers to those checkbox questions (e.g. kissing, vaginal penetration, etc)

Josh Josue (jjosue@shield-legal.com)

2025-06-16 13:43:39

so I will go ahead and integrate LLM for that searching process

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-16 13:57:30

Awesome!

Josh Josue (jjosue@shield-legal.com)

2025-06-23 15:23:22

Devon told me that I would have to ask Abe for the "why" part of question 4.

So I'm thinking of requesting a blanket statement on that as well?

Josh Josue (jjosue@shield-legal.com)

2025-06-24 13:16:26

i spoke with Alison and she said that IF a case is Completed then they have all the info on it - including the yes/no answer to "Did you file a report?"

Josh Josue (jjosue@shield-legal.com)

2025-06-24 13:17:20

And we would need a blanket statement for "Why didn't you file a report?"

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-24 13:38:12

OK sounds good

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-24 13:38:22

we would only want to look at the Completed ones any ways

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-24 14:48:44

Can you send me an example output of what you've done so far?

Josh Josue (jjosue@shield-legal.com)

2025-06-24 14:49:02

sure, one sec

👍 Nicholas McFadden

Josh Josue (jjosue@shield-legal.com)

2025-06-24 14:49:22

[ { "Plaintiff_Name": "Andrea Marie Baca", "Individual_Case_Number": "", "Plaintiff_Action_Type": "new_case", "Add_On_Petition_Filing_Date": "", "Defendants": { "State_And_CDCR": false, "DOE_Number": "", "Named_Individual_Defendants": [ { "Name": "", "Correctional_Officer": false }, { "Name": "Plaintiff does not recall name of abuser and could recognize in a photo line up.", "Correctional_Officer": "correctional officer" } ] }, "Year_Of_Abuse": "2010", "Location_Of_Abuse": { "CHOWCHILLA (CCWF)": true }, "Plaintiff_Incarceration_Status": null, "Number_Of_Assaults": "4 incidences", "Details_Of_Assaults": { "Kissing": { "Occurred": true, "Body_Parts": "breast, mouth", "Quote": "he stopped to talk to me and proceeded to feel my breast and kept feeling the rest of my body. Plaintiff reported the abuser touched her breast with his hands, as well as with his mouth." }, "Fondling": { "Occurred": true, "Body_Parts": "breast, vagina", "Over_Clothes": false, "Under_Clothes": true, "Quote": "Plaintiff reported the abuser touched her breast with his hands, as well as with his mouth and that he rubbed his penis against her as she was pushed up against a wall. Plaintiff reported the abuser grabbed her from behind and rubbed his penis against her as he touched her vagina with no gloves on. Plaintiff reported one incident of digital penetration with no gloves on." }, "Vaginal_Penetration": { "Occurred": true, "Quote": "Plaintiff reported the abuser grabbed her from behind and rubbed his penis against her as he touched her vagina with no gloves on. Plaintiff reported one incident of digital penetration with no gloves on." }, "Anal_Penetration": { "Occurred": false, "Quote": "" }, "Oral_Sex": { "Occurred": true, "Quote": "Plaintiff recalled an incident of sexual abuse occurring outside in a blind spot when Plaintiff was sitting down and reading when the abuser approached her and forced her to perform oral copulation. Plaintiff reported the abuser grabbed her head and pulled her toward him while telling her \u201cyou know what to do with it\u201d." }, "Masturbation": { "Occurred": false, "Quote": "" }, "Other": { "Occurred": false, "Type_Of_Abuse": "", "Quote": "" }, "Additional_Description": "" }, "Govt_Code_845_6_Medical_Description": "", "Govt_Code_845_6_Why_Known_To_Staff": "", "Search_Only_Explanation": "", "Claims_Asserted": { "Sexual_Assault": false, "Sexual_Battery": false, "Gender_Violence": false, "Intentional_Infliction_Of_Emotional_Distress": false, "Govt_Code_845_6": false, "Bane_Act_Civil_Code_52_1": false } } ]

Josh Josue (jjosue@shield-legal.com)

2025-06-24 14:49:36

so ideally, there would be an array of records per case

Josh Josue (jjosue@shield-legal.com)

2025-06-24 14:49:45

this is just the Baca record

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-24 14:49:45

aweseome

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-24 14:52:50

thank you

Josh Josue (jjosue@shield-legal.com)

2025-06-24 14:53:51

the Claims_Asserted field just has placeholder values. I'm not sure Im going to keep it

Josh Josue (jjosue@shield-legal.com)

2025-06-26 19:39:52

Andrea Baca is actuallly such a case where the Plaintiff couldnt recall the name of the abuser

👍 Nicholas McFadden

Josh Josue (jjosue@shield-legal.com)

2025-06-27 13:46:22

I asked Devon and Alison about No.9 and they said the answers to these are probably gonna come from Abe

image.png

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 13:48:17

Draft what your questions would be so I can forward to him please thanks

👍 Josh Josue

Josh Josue (jjosue@shield-legal.com)

2025-06-27 14:31:05

Joe was holdin me up so i found my own solution installing stuff

Josh Josue (jjosue@shield-legal.com)

2025-06-27 14:31:12

Filled_Form_test.docx

Josh Josue (jjosue@shield-legal.com)

2025-06-27 14:31:52

here's a sample of a filled out form ^ (it doesnt fill out number 9 filled out, and DOE fields)

Josh Josue (jjosue@shield-legal.com)

2025-06-27 15:52:36

my question for Abe is:

For Question 9 on the Short Form, are the answers to the checkboxes derived from the Plaintiff’s description of the incident? Or will they all have the same boxes checked?

🙏 Nicholas McFadden

Josh Josue (jjosue@shield-legal.com)

2025-06-27 17:33:46

```For Question 9 on the Short Form, there are checkboxes for claims:

First Cause of Action for SEXUAL ASSAULT
Second Cause of Action for SEXUAL BATTERY
Third Cause of Action for GENDER VIOLENCE
Fourth Cause of Action for INTENTIONAL INFLICTION OF EMOTIONAL DISTRESS
Fifth Cause of Action for VIOLATION OF GOVERNMENT CODE SECTION 845.6
Sixth Cause of Action for VIOLATION OF BANE ACT (CIVIL CODE § 52.1)

Do the cases all have the same boxes checked? If not, how would we derive the answers to them?```

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:21:35

his answer was derived from answers

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:21:48

oof

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:21:56

i dont trust an LLM to do all that

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:22:39

even with the Question 5, it doesnt extract at 100%, more like 85 - 90% reliability

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:23:21

An ai agent would have to be given the semantics for each of those clauses to be specialized for them

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:24:48

What do you need for the semantics?

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:25:22

What do you need for the semantics?

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:25:33

so for James's project, we fed it a long pdf doc about how drug tests are properly performed

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:25:37

phrases, examples, etc?

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:26:10

THEN we gave it pdf's of the drug tests and asked the LLM to determine if there were things that the experiment missed or malpractice

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:26:32

but that could take a while to test since I would have to manually validate results per case

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:32:29

ok then I will tell him that: We are currently not confident in the LLMs ability to determine these. Even in #5 we are seeing 85-90% reliability. The model would need to be given semantic information to hopefully improve it. For example, in a different project we had to feed it a long pdf about how drug test are properly performed. Then we gave it pdf's of the drug tests and asked the LLM to determine if there were things that the experiment missed or malpractice but that could take a while to test since Josh would have to manually validate results per case. Do you have an input/recommendations for how to handle these or will we have to resort to some manpower to manually review?

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:32:34

Thoughts?

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:34:30

i think that's a fair summary

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:34:31

We could suggest that given a document filled with the semantics as to what constitutes any of these acts (e.g. GENDER VIOLENCE), I could see how well it does

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:34:48

But I don't know if that's within the bounds of his timeline

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:39:17

We are currently not confident in the LLMs ability to determine these. Even in #5 we are seeing 85-90% reliability. The model would need to be given semantic information to hopefully improve it. For example, in a different project we had to feed it a long pdf about how drug test are properly performed. Then we gave it pdf's of the drug tests and asked the LLM to determine if there were things that the experiment missed or malpractice but that could take a while to test since Josh would have to manually validate results per case. If we could get a document filled with the semantics as to what constitutes any of these acts (e.g. GENDER VIOLENCE), we could see how well it does. Otherwise do you have any input/recommendations for how to handle these or will we have to resort to some manpower to manually review?

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:39:45

Good to send?

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:39:50

we will see what he says

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:39:56

and talk more monday

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:40:57

Looks great!

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:41:02

have a nice weekend!

Josh Josue (jjosue@shield-legal.com)

2025-06-27 18:41:09

Thanks for sending that!

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 18:41:30

Thanks right back at you

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-27 19:18:01

From Abe: we will see what you have on monday and make a plan and figure out what we can v what we cant pull out plus how the human review will have to work.

👍 Josh Josue

Josh Josue (jjosue@shield-legal.com)

2025-06-30 12:45:04

side note: I'm still running into some issues parsing the ACTs docs - they dont follow a consistent convention (e.g. some answers are on the same line some arent, some answers are multiple paragraphs, some keys to fields are different, etc.)

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-30 15:43:52

drochen@dicellolevitt.com

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-30 15:44:17

mabramowitz@dicellolevitt.com

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-30 18:09:13

Hey Alan came over to tell me that you have been using the ACTS only version. We need to use the secondary interviews from DL - Flatirons and ACTS -DL - Flatirons. Unfortunately, he told me the formats are different. Can you get with them tomorrow and they can show were to get the right ones.

👍 Josh Josue

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-06-30 18:20:59

Can you go find and work with Ralecia first thing tomorrow morning. They will make sure you got what you need and align

👍 Josh Josue

Josh Josue (jjosue@shield-legal.com)

2025-06-30 18:31:24

yea im currently talking to Devon to get the right sample docs

👍 Nicholas McFadden

Josh Josue (jjosue@shield-legal.com)

2025-07-30 11:10:14

Good morning Nick, i've got a fever and will be staying home today. i'll keep an eye out for any emails from Abe in case he needs anything urgent though

Josh Josue (jjosue@shield-legal.com)

2025-07-31 11:16:55

hi Nick, I'm still not feeling well, but hopefully I'll be able to come in tomorrow

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-07-31 11:17:12

Hey I’ve been out too

Josh Josue (jjosue@shield-legal.com)

2025-07-31 11:17:33

oh dang, hope you get well soon too

Nicholas McFadden (nickmcfadden@shield-legal.com)

2025-07-31 11:17:40

Just try to watch out and respond as you can