ePRO and Cancer Research: Measuring the true patient experience
Learn how oncology trial sponsors measure patient-reported tolerability, core symptom concepts, and treatment experience using ePRO.
Ari GnanasakthyPrincipal Scientist, Patient-Centered Outcomes Assessment, RTI Health Solutions
Derk ArtsFounder & Chief Executive Officer, Castor
Ari GnanasakthyPrincipal Scientist, Patient-Centered Outcomes Assessment, RTI Health Solutions
Derk ArtsFounder & Chief Executive Officer, Castor
About this webinar
This on-demand webinar examines how patient-reported outcomes and electronic data capture are evolving in oncology clinical trials. Designed for clinical trial sponsors, study teams, and outcomes researchers, the discussion between Castor's CEO and an expert from RTI Health Solutions addresses the shift from traditional chemotherapy studies to adaptive designs for targeted therapies, immunotherapies, and CAR T treatments. The speakers analyze why regulators distinguish drug safety from patient-reported tolerability, and how sponsors balance US FDA core concepts with payer demands for historical comparability. The session also covers practical trade-offs between paper and electronic collection, optimal timing for capturing symptoms during treatment cycles, why physician reporting misses lower-grade adverse events, and bring-your-own-device considerations.
Key takeaways
- The US FDA recommends assessing core concepts in cancer trials, specifically physical functioning, role functioning, symptomatic adverse events, and symptoms of cancer, while payers often still expect older questionnaires for historical comparison.
- Tolerability is distinct from safety and combines dose modifications, delays, and interruptions with patient-reported symptom bother, which must be captured at home during treatment cycles when drug effects peak rather than only at clinic visits.
- Clinician adverse event reporting focuses on severe clinical events and frequently misses grade one and grade two symptoms, even though those milder daily complaints often determine whether a patient continues treatment.
- The fifth question on the FACT-G questionnaire regarding overall bother of adverse events shows high predictability for both study dropout and disease progression.
- Physical and role functioning change slowly and can be measured every second or third cycle, whereas tolerability assessments can focus on the first three to four cycles unless late-emerging toxicity is expected.
Full transcript
Good morning, everyone. Good afternoon.
I hope that's, that woke you up. It certainly woke me up.
Aside by, Brad hightower to have a bit more engaging music.
Ari, welcome, and good morning. Thank you so much for, for joining us.
Good morning to you as well, Derk, and good morning, everyone. Thank you.
Looks like we have, a hundred and two. Actual live attendees. Great score.
This could be one for the for the record books, and I guess it's because we're talking about, some very important things today.
For everyone that doesn't know me, I'm Derk Parks, I'm CEO and founder at Gaster.
I have a, a history long, long time ago as an MD PhD an epidemiologist, but that does mean I'm still very much interested and engaged with, with the science, and real world evidence and an evidence based medicine. And so I'm very excited to have one of the world's experts on these topics in the context of patient reported outcomes near with us. Alright. Maybe you can give us a quick recap of your story and and what land did you hear in this webinar.
Thank you, Dick. So, well, welcome, everyone. My name is Ariana Septi. I'm at RTI Health Solutions, based here in North Carolina in the in the US.
My background was in biostatistics, but that was a long time ago. I've been in the pharmaceutical industry for about for, thirty five, forty years, perhaps, before that, I was an angry person about that with a very long time ago.
And, anyhow, I sort of gravitated towards, patients reported outcomes, over the last probably fifteen years, and, sort of, built up by expertise, especially in the area of oncology in the last ten years.
So, anyway, looking very much, to this, webinar that's put together by, Doug, looking forward to discussing.
Generally about the, science where things are going and also, some, data capture issues. Thanks, David.
Yeah.
Yeah. So I think today, the goal is to do about forty minutes of, of stalking maybe a little bit less and then, have room for, for Q and A. And your goal will be to reach to speak about specifically, patient reported outcomes in oncology. And, of course, in the context of Epro, Castor is a platform that offers Epro capabilities and, I think there's a lot of, evidence in the world that shows that April is a really great way to measure these outcomes. But maybe we should, maybe we should start there, Ari, with with my first question for you in this in this fireside chats. Alright. So it's gonna be a lot of of me asking questions and him answering.
I think if we're looking at the regulatory landscape and then specifically in the context of oncology trials, how do you see these changes shaping up? How is it changing the way we we run trials and what are the requirements shifts that you see?
Yeah. So just just to provide some, overview of the landscape, thanks there, by the way. By the way, I know this is supposed to be a fireside chat. Oh, there's a very chilly call going here in in New Jersey.
Anyhow, so, oncology studies, transfer studies are not what they used to be.
They used to be very complex, during the times of just chemotherapy, but now they are even more complex. Because now we have targeted therapies and immuno therapies. And yesterday, I was talking to a client about last month, derived therapies, very, very complicated.
We have CAR T therapies that have they have very different, safety profile.
So to cap shift patients' experience, remember, we we we should kind of stop talking about patients report their outcomes, although that's the sort of regulatory term, but if you if you want to truly capture patient's experience, then these nuances are beginning to impact the way that we capture data and analyze and report data.
Not only we have, the the treatment paradigms that are changing, but also the study designs are now very different. It used to be two arm studies or single arm open open label studies, but now we have adaptive designs, studies, or import studies, all sorts of different things, and the the the the, challenge of capturing patient experience to provide useful information at the end of the study to demonstrate not efficacy or safety or tolerability.
But patient experience is, that much more challenging. So it's a it's a much more technical press the button capture data than, what it used to be.
Why why is it more challenging? What what what makes it what makes these novel trial designs and these novel novel therapeutics that are more super super exciting and promising for from biology patients, what what makes it, harder to to measure these things in this this trial?
Because I think I think it's it's don't want to use the word hard. It's challenging, because the the flexibility of study designs to make very quick decisions. So oncology studies by nature, they they are developed very fast. The development time is very short protocol development time. Decision making time is very short.
The regulatory people, they go through accelerated review programs, and there are special programs to come to quick decisions.
So the the the development time frame, and the study designs that goes with it, very challenging, very, very short. Yeah. They are very tight. It used to be like phase one, phase two, phase three.
You take your time between phase two and phase three to come up with a protocol, talk to the pro vendors and to come to decisions, but that's not the case anymore. So it's like phase one, phase two, and then zoom into phase three. O phase one, phase two, and decision point. And the study design design, they don't have this convenient gap in between to think about things when it comes to decisions.
They they are either seamless designs that sort of flows from one to the other, or they have very, very short timelines.
The patients so that's the, that's the study design part of these. The patients are usually, very ill, if not very sick. They can be very elderly.
They can be pediatric. There are pediatric studies, as well. And so these patients can start off at the age of five six seven. They can sometimes stay in the study during their teenage years. So they are going from childhood being children to adolescents, you know, sometimes even adults.
And so during this time, they are growing physically mentally, but their educational ability to be able to read and write and comprehend may not be, equal into their normal peers because they have missed out in school. So when when we look at the questionnaire design for a ten year old. Maybe it should we shouldn't pick up a question at for a ten year old. Maybe it should be a Sonya or eighty year old. And these these are these these are challenges. I mean, these are some of the some of the challenges.
So, how if you look at you know, I don't have the recent data, but I think we both know there's a lot of studies still using, you know, paper, reported outcomes and usage a set of instruments that have been validated maybe even twenty years ago. And that everyone's comfortable using just because they've been validated and it's what everyone's been doing. I mean, if we're being honest, we see a lot of that in our industry, right, because we do not wanna rock the boat. You know, nobody ever got fired for choosing the same instrument that we've been choosing for for the past twenty years.
How how does that world collide with this global car teeth, therapies that are more more personalized with younger patients, you know, with patients being, more in control. How do you see those two worlds collide? And what are the challenges that emerge from? From there in terms of, getting it right. And what is required to to address that?
This this this is, this is a very interesting point that you are making, and it requires some serious thoughts and, I might be upsetting a few people, on the call or you and outside the home. So one of the things that the, study sponsors do when they are asked to set up a study in colorectal cancer, some cancer is to see what other people have done. So they go go to clinicaltrials dot gov. They'll to to see your what adviseable?
What did general feel? What did Novartis do? And then copy what they did because they must have really told to they think they must have really told to to come to the conclusion whatever they did that may not be the case because it's usually they are in the same boat. They were in the same boat as you are now.
They had to make a decision in, like, two, three days. So they're just throwing something. So mistakes, repeated.
And and this is one of the reasons why even the industry complain that the FDA do not give labels for, you know, there's no not many labels, labels in the sense, for a regulatory endorsement of value statements for oncology studies is because you keep repeating the same mistakes that some some guy did thirty years ago. And if that's a very simple way of, saying what's going on, so you are right there that there were questionnaires that developed twenty, thirty four, four years ago, a long time ago, that we still use, and the the US agency, the US FDA has they didn't say that at all.
They said, well, there might be value in it, but we would like to see some core, concepts being assessed in, cancer level and they said the core concepts are physical functioning, role functioning, symptomatic adverse events, symptoms of cancer. That's all.
So they they they recommended some core concepts.
Now that is which is nice, and that's good to do. But that's not always in in sync with the, pair groups. They like to see what was nine, ten years ago, five years ago, twenty years ago, because they like to compare one with the other. So the sponsors are always conflictive.
You know, they have to be at the cutting edge of regulatory paradigm, but at the same time, they have to freeze the pairs as well. So it's it's a kind of so we don't see much shift. We don't see much shift in the way things are being done.
But lately, what I'm seeing is more and more, clients, more and more sponsors, going satisfying the needs of the US regulators, and, accommodate accommodate the needs of the payers. It doesn't make the data collection any smaller, it refines a little bit. I mean, there there are some improvements in the margins.
I don't know exactly. This is exactly what I was writing down.
I think, do you, I guess, you're you're answering this question already, but let let me just ask it. You see sponsors actually building on top of the traditional way of doing things. So, you know, imagine, you know, we'll we'll get to tolerability later, And next, we have a couple of questions. I'll be just curious to get what you see, like, traditionally, it's clinicians reporting, tolerability, which is kind of strange. Right? And one all kind of strange. It's very strange.
But it's just how we did it. But you don't have to walk away from this, right? You could you could say, look, we keep doing because that's what the data that the the payers are used to. But, actually, you know, if if the regulators are already saying, hey, it's more important to to to to measure the true patient experience, I think at some point, it's it's very likely that the the consumers, the patients will also, you know, pick up on, hey, this is important.
And that ultimately, I think, will we'll get to payers to look at it as well. Right? And I think we're in an era of, you know, value based health care and much more thoroughly measuring, you know, what is the impact there? Actually recently, I saw a study yesterday.
I think we looked at two hundred and forty six drugs that were approved by the FDA, and forty seven of them, were actually not approved by auto regulators.
Right? So it's actually an interesting dynamic also plays additionally in in the US where, in in other, like I said, in Europe, they they are actually already more stringent. All I'm saying, look, is there actual real net benefit here? The net benefit includes, all these very complex economical measures of, of quality of life.
And, and, thankfully, we're progressing from from there. But I think we're already seeing a trend globally that it's not as simple as just doing the same thing as someone did before. Right? You actually have to start to show is this going to make the patient's life significantly better and is that worth additional additional cost?
Right? So are you are you saying you're seeing that play out already kind of adding the the foundation is in place and adding on top?
Yes. I mean, it's it's it's beginning to it's beginning to play out. Let's let's cement whether the regulators or the sponsors say that your drug is totaled or not, that patients will make a decision. If it's not trouble, they're not, you know, they wanna move away from it, especially in, in, in, in, like, say, breast cancer, prostate cancer, but there are many drugs. Patients have choates. So this is why the the US regulators now putting a lot of emphasis on assessing tolerability.
Now, safety is not same as tolerability. It used to be confused.
I mean, we used to try to see Let me let me pause you for a second, Ari, because we have a poll on that.
So can we can we launch your first poll question? Because I'm actually interested what the what the audience has to say on how they measure Are you is this clinician reported for you? Is this, you know, are you using some paper ad hoc measurements on top of, on top of the clinician data, or are you using are you using Hebrew? Let's just give the let's give the audience a moment to, to vote.
Yeah. I see we have, a hundred and thirty one participants. So we should get some pretty, pretty clean data. Maybe even some statistical significance if we're lucky.
Let's see.
And then go ahead. Sorry. I interrupted your train of thought. Yeah.
No. Because, we used it to see, in journals, the conclusion, after clinical study. That says, this drug, involves your survival by this might, blah, blah, and it's safe and tall.
And, then people started to ask questions. Now, wait a minute. Who said it's tolerable? Because something that is tolerable can only be said by the patients.
So we now see, a move. I mean, even this morning, there was a paper published in New England General of Medicine. That's that's it. This drug has similar safety profiles to other drugs, in in the same class.
Didn't mention the word tolerability. So, you know, we have been able to see, some shift. And the, the regulators, the US regulators, especially now want to see evidence of tolerability and it's measured in different ways, tolerability is from just one thing or one question. And, measure in different different ways.
To assess the risk benefit of the drug. How does the the, you know, does the tolerability goes more towards the benefit, otherwise? So it's we haven't seen the label for tolerability, but we are beginning to see some noise made in the review documents.
Aft after the poll answers.
I want to show, a slide if that's okay with your Yeah.
Yeah. Let's close the poll. Let's look at the answers.
I don't I don't have the superpowers to do that. Oh, wow.
That's that's fascinating.
That that seems almost, statistically unlikely. There's a very even distribution as as you probably can see as well.
As even as it could have been, basically. Well, not not true. It could have been twenty one, twenty one, twenty to be able to be fair. But Yeah. So, yeah, I guess, I guess, we're in a transition phase. Right? Maybe that's the best way to, to summarize in, Ari.
Right.
So let let me let me show, let me share a screen. Tell me if you can see this.
Coming through?
Yeah. I have full screen.
You Okay.
Super. So, tolerability is a combination of safety data, treatment data, those modification, those delay, those interruptions. And these are all the stuff that happens in a typical cancer study. And patient experience data. So the patient experience data, and these are the things that I said that the FDA, like to see physical and goal functioning, symptomatic adverse events, overall side effects burden, additional quality of, health related quality of life data, and then you can also have data from warehouse and sensors. All this comes to, into the pool of what what the agency call as, as as tolerability.
So this is the piece that we are talking about. You and I are talking about at this moment.
With those in the in the webinar. And, let me show you another slide, and this is the drug, t fours enable. Where the reviewers said, look, the dose interruption is lower than the comparator. Those reduction is lower. Than the comparator, do those disconnect continuation is lower? So they said the lower rates of those reduction interruption or permanent discontinuation, supported by the overall bother results, and this is the patients reported outcome, okay, both are reported by patients, demonstrate a likely overall improved tolerability.
Over accepted standard of care. Okay. That now this is so it's an it's a it's it's this is the first time we, at least I saw the, an acknowledgement by the FDA, how patients reported outcomes in combination with or the other stuff that's going on in in the clinical trial contribute to, the argument of tolerability.
So you're saying because patients don't, let's equate the drug as often, the simplest way to put it.
We we are assuming basically higher tolerability. Right?
But I mean, that's that that seems a very A good total of systems.
I mean, yeah.
I mean, it's, yeah, it's a bit of a tolliver because then the competitor Yeah.
Yeah. Very interesting.
Come back. And so this is the first time you've seen that you're saying.
Yeah. That was that was let me just see that was two thousand twenty one. And since then, I've seen, like, a couple of other examples when this this sort of decision, made. So patients reporter outcomes now contributes to a decision on tolerability or or acknowledgement of tolerability. There's no p value here, by the way. The acknowledgement of tolerability that contributes to very risk assessment of the experimental drug or the origin.
Yeah. And so where do you see this going? This is a trend that's gonna just be relentless, and and there'll be more and more actual demands. Look, it's one thing if, if it's a suggestion by the FDA, by the EMA, it's another thing when they start to basically require you to do these things and to actually measure, quality of life or tolerability in a in a more, let's say, accurate way because we haven't really touched on that now, but I think we we both know that a lot of quality of life even still happens on paper questionnaires in a clinic, right, which which clearly doesn't reflect reflect the true through patient experience.
So are you, are are you seeing this as the beginning of a of a shift where you actually have a mandate from, or or, mandatory requirement basically from the regulators to measure more frequently and measure true tolerability and true patient experience, or do you think they're going to be careful in in adding those requirements because then it doesn't even matter what they say anymore. Right? Because you just have to get through that phase just to get your your drug approved.
There there is the regulators. There there's very little the regulator's mandate. Alright?
Mean, there there are some ethical issues in Right.
Yeah.
That they mandate. These are suggestions. If you want to show your drawing, in a good light. Otherwise, it's safe, efficacious, and now for oncology drugs. Torrow of as well. It's up to you to demonstrate that. Now if you don't, something's going to be missing in your value proposition.
And the the regulators don't have a piece of the jigsaw that they need to assess the benefit risk of the drug.
Now then you have a different, another point about how the data are being collected, how it should be collected, so on and so forth.
Let me say it's something about paper versus, other electronic means. There's no mandate from the regulator to say you must use people.
They are interested in data of good quality.
That that's what they want. Now whether you use paper, electronic, wristwatches, variables, drawings. It's up to in it's it's up to you.
But they do acknowledge that electronic data capture provides better quality of data for all the reasons, that that we know now.
We can do think that's like, this is today, right, clearly, but I'm I'm asking, like, let's fast I I think it would be, let's say, curious in this time where where, you know, it's it's definitely the area of the consumer, right, where the experience of the individual is is being prioritized. Like, I mean, I would expect at some point, we might as well bring that moment forward, right, to make it part of the approval, like, why it goes through the trouble of approving If you know, never nobody's gonna ever use it anyway. Right? But it's just Oh, absolutely.
Yeah. Yeah. Yeah. Yeah. Oh, no. I mean, this is, I mean, this is now, you know, study sponsors are beginning to I would say at least in two thousand twenty three, two thousand twenty four, the studies I've been involved in, they all had some assessment of tolerability.
So from my where I'm standing, it's it's routine whether that's the universal or not. I'm I'm not so sure.
I I can't I I cannot vouch for that. And we will see when these studies start to read out in a couple of years time and publications start to come in three, four, five years time. We will see more and more of this sort of information being shared.
Now tolerability is not something that can be measured at the beginning of each cycle when patients are reasonably healthy to receive the next cycle of treatment.
Tolerability is something that needs to be measured when patients are having, sort of, issues when the drug is at peak in their body. Okay. It could be a week, ten days, after taking the drug. If it's an oral drug, of course, then it's it's uniform, but it usually in in cycles, IV cycles, you know, you're you're looking at, when patients are having symptoms or thinking about how tolerable their drug dates, you know, they're having diarrhea, nausea, vomiting, appetite loss, and all that sort of thing.
The middle of the cycle or few days in Google cycle. So we're looking at collecting information to inform tolerability not at the beginning of each cycle or end of the cycles, but during the cycle, that means when they are at home.
Probably on a weekly basis.
Okay. That leads us to the data capture issue, which means it will be good to have, alarm going off, or tomorrow Sunday evening or whatever to say, you know, can you now complete these questions now and patients open up their devices or look at their variables and provide information that's captured real time. And we have a time stamp, and it's accurate, and it's reasonably quick. And, the word, the word is not and it's it's reliable and valid.
So what we have seen I've seen some customers of ours, actually using MixTA. Right? So they've, you know, they've obviously captured all the the data they would normally capture. They they added, scheduled epros that were delivered through our app to patients just in the way described, but that it also enabled the option for ad hoc diaries, if you will.
So do you see a role do you see a role for that? Do you think tolerability should be measured on a fixed schedule, or can we also, you know, obviously, thinking, ahead a little bit. Like, if we only measure tolerability as an ad hoc diary, of course, we could see some level of selection bias as in, like, we only hear it when it's at its worst, but maybe that's the point. Right?
Maybe we only wanna hear about it when it's at its worst. You can you comment on that, like, scheduled data collection versus ad hoc and maybe just blending it too?
Because because I mean, that's yeah.
I mean, that I mean, that's I mean, that's a strategy, but it's not the most optimal because you want to know how many people, you know, how many people had issues and how many people didn't have issues. And just because you have no information, it doesn't mean that there was no information. It's just that the nobody provided information. I do see, data being collected, on, you know, related to symptom and a border of symptom, during, during the cycle, but information related to, let's say, physical functioning, character at business started business.
Using iPads or some some device.
But I've recently, they also face one study where they, decided to use paper. This is a phase one study, small study. So there is a place for paper data collection, because these studies are fast and the and and and the study sponsor said it takes eight months from contract signing to device deployment, and that is not something that can be a folder. When you have a phase one study decisions made within three, four weeks.
So there's a place by necessity, for people.
Well, I mean, I I I would question that. I I I don't think we've ever seen that.
At Gastro, maybe it's not a fair comparison. I'm not sure what they were trying to do here.
About eight months.
Yeah. I That's not that that doesn't seem like an acceptable do you is is that really you think a a reason why people switch to paper? Because these time deployment timelines are so so long.
I mean, that's one reason.
Yeah. I mean, that's certainly is, I mean, I mean, I mean, this is now you're opening up a pandora's, have done all the box here, you know, why sponsors do various various things.
But that is there is one reason, the time taken.
The second most common reason is the internal expertise within companies. I mean, there are only top ten pharmaceutical companies in the top ten list.
There's a whole, you know, there are hundreds of smaller companies. I'm sure there are many people here on the webinar now, where they don't have an operations team to provide support to bring in an EPO vendor to assess the devices to deal with all the technology issues, the scientists may have to do that, and they will not claim in these things either. So there is there's a lack of, expertise internally.
And I would say from some of the examples that I hear, there's lack of expertise in the intro vendor, space as well. I mean, they are good technicians. They, good at electoral ins and data plans to enroll that issues, but they don't understand canceled status, you know, The study in Solis is not same as studying cancer studies, and sometimes project managers get switched from one therapeutic area, you know, they are bumped into a cancer study and date dates as well. Get it. And that causes a lot of, lot of friction as well, and lot of issues as well. So anyway, in the I mean, there there are different issues, but there are many reasons why people grudgingly use people.
Well, I I just wanna, you know, I love I love a good debate.
Right? So I I don't really understand how paper solves that problem of a a a an average Epro echo event and not understanding, like, cancer trials. So you are basically saying, a, it takes too long. Be maybe it's too expensive.
You know, I would I would also argue that that doesn't have to be the case, but, you know, we'll get to that. And then see if they would go work with an approved vendor, they don't actually know how clinical trials work, but you're just that they don't have that in house experience. So how does papers solve that problem you still So, like, that's the whole point. Right?
Like, I've I've yet to see the first first only Epro questionnaire. All these questionnaires that we build in Epro, we're desperately trying to make them mimic paper, which, of course, is, actually nonsense, but okay.
Let's park that one. I mean, that's a separate when we when you go into a study team meeting and say, I you know, we want to collect, you know, patients reported outcomes, and here is a paper diary everyone understands it. I mean, you and I Okay, man. Half the people here know the difference about parking lot, in fact, and timestamps and so on.
Everyone gets it. And then if you don't have the time to discuss options, you go with that and the clinical operations team or the study coordinator and the CRO person, they get it. They understand it. Unless you have someone who had experience, outside, with evil.
And by the way, I'm gonna get to meet's response and you may not like what I'm about about to say. I'm I'm get to meet a a a study sponsor who said, Harry, we had, you know, you know, on call this study, and we hired this ecoa company, and we had no issues.
There's always some some chaos that went on, that left a bad taste in the amount. The other the other thing, and I think we are slightly going off the topic here, but it's worth pointing out is that the the the the preferred provider e four companies are bought into the company by a whole bunch of people who don't understand patients reported out. Okay. I mean, they they are they so they are bought in by the contracting people based on, I don't know, cost and how the presentation went and our strategic presentation was. And then they they being the the the the study teams are asked to work our force to work with the company that was selected.
So that's that's one issue. The second issue is most oncology studies, if not majority of studies are found out to a CRO to to manage, and they either they have internal expertise on EPO. They might have their own EPO port program, or they found that out to a third party EPO company so that the the PRO guy, the HEO guy sitting in the company is like six degrees of remove from what is happening.
And that I mean, at least I know a couple of cases, which led to total chaos, and millions of missing data and lots of, missed opportunities So there are many reasons why inks go south, and that leaves, you know, a lot of bad taste, with people. And not it's all the fault of, you know, there isn't one particular group where you can point to and say, this sometimes there is, but most of the time there is each.
That is I mean, I I feel like we we should probably schedule another webinar just talk about how stop that from from happening, because I will say, I think from where I'm standing, obviously, I'm biased.
There is a there is a net benefit to to better measurements. Right? And nobody said, don't don't, use some of your your basic instruments that you've used for a long time, but I think it's clear now. I I said, basically, see three layers of data. Right? We have our our our core data that we've been collecting for twenty years, then we layer in scheduled quality of live tolerability data, maybe even on top of that additional wearable and ad hoc data to even further understand quality of life and tolerability.
You know, I think it sounds like that's a huge opportunity that it's gonna benefit patients dramatically. And if it benefits patients dramatically, it will ultimately work its way back into into the system. At the same time, I'm I'm I'm hearing what you say and sometimes maybe you think, well, it's not worth, worth the effort.
But I think, you know, that that that's probably something we can spend a lot more time on how do you prevent it. Like, what we see is that we give early access. We actually invite a study team on our form so they can at least, get through the patient experience themselves. I think the patient experience on onboarding is super critical and as a as a success factor.
You know, we offer direct support to to alleviate, you know, side burden. And, obviously, we we have the option to to even give, you know, let's say synthetic data from a trial ahead of time to look at, hey, can we actually analyze? I I feel like there's a lot of things that can be done to derisk things. But I agree with you. If you just get a vendor drop in your lap, then you're it's an uphill battle from, from there. But but that's, maybe for another day.
I'm, you know, we're getting some questions and we're getting we're getting close to, to time.
I, let me see. I had one, question still for you. So I think on the topic of, of adverse events, we haven't we haven't spoken on that on that so much. I mean, there's also an obvious, I think, benefit of electronic technology that you can capture these inverte events as they as they happen and notify side staff, but you know, educate me, like, how does that work with with papers? It's just, you know, a phone number that people call.
What's the, what's the, what's the regular way of the old school way of of of doing that first is, just the immediate So, I mean, generally average speaking, you know, patients come on their visit, and the decisions saved.
So, you know, how are things and duration saves? We know I have no idea. Those are the only thing one had to rash.
I have this problem, that problem, and the physician assess the severity, decide whether that is worthy of reporting as an adverse event and reports the adverse events.
So a lot of grade one adverse events, these are the very mild complaints by the patients don't get reported as adverse events.
Grade two, not necessary.
Three most of the times for probably always five is death anyway. So that'll that'll be perfectly perfect. So what we have is a situation where the adverse events reported by physicians do not reflect patient experience because physicians are interested in clinical events. They are thinking about, okay, we got these issues should I increase the dose? Should I decrease the dose? There are clinical events. Is this patient going to go into hospital?
Is that going to be death coming along?
Some severe core morbidity. So they're looking at clinical events that might be, that may be lit that may lead to.
By these complaints that the patients are talking about. Whereas, patients have to deal with day to day stuff, so they are take take a typical breast cancer, young mothers, school runs. They have to look after their patients, and there are cultural issues.
I recently posted a paper from India where, you know, women they are defined by their care, and they don't even want to complain about, they don't want to have treatment. They don't want to complain about complain about panels. So there are many cultural issues that hides, the grade one, grade two adverse events. Or not reported even if it's set.
That's a that is what tolerability is. Okay. It's the lower end is what tolerability is. And that's what the that's what decides patients are you going to con am I going to continue with this treatment or not?
And the, and, you know, we are back to that discussion here, about, with with regulators wanting to know for, this benefit. One of the things that's happening now in the oncology field that's more in real world studies than clinical trials is patients reporting their symptoms real time to physicians. So, you know, they're they're having some issues. They got migraine.
Hit the button, it goes to the physician, and they immediately, or soon after decide Okay. Right. You know, this is expected. Don't worry about it or go to the emergency room, and deal with it.
Or we'll send you a nurse. Some some actions will be made. So that is now beginning to I mean, there are there are people who specialize in this sort of real world data collection, and that's beginning to be I see more and more that happening. And there are papers, that shows when you bring that dimension into a cancer treatment, the outcomes are better.
Patients at least in some of the, matumas, where they're going to study, and avoid long term adverse events because you don't have to wait for three weeks or six weeks to come to to complain about something.
Yeah. I think that's what Joe, Joe Dustin was also referring to.
We have a couple of questions, and I wanna just, ask the audience. I think coming in now, but I think before we we jump to the Q and A, if if you could recommend the the study teams on this call now or the sponsors let's say, you know, with all the all the combined interests of ultimately, getting the payers to endorse your drug as well. What would be your your recommendation for the ideal approach for, let's say, for a phase two, phase three study in terms of collecting patient data. If you could summarize it, so, and feel free to go know, does it even is it paper?
Is it Epro? Is it BYOD? Is it provisions? Is it, you know, like, what's what are your recommendations?
How would you structure it? Or is that too broad a question?
In terms of data collection, you gotta focus on the quality of data, thinking about who is going to look at it. Now if it's for internal purpose to look at how things are going, that's a different matter, buddy. You are going to interest the regulators.
If you are going to avoid missing If you go into capture, yes, you have missing data, but also the reason for missing data, then I don't have there's a paper published this morning. I I looked at on LinkedIn post.
Then you need to look at electronic data capture. Now if you want to capture, tourability, which is beginning to become more of a thing. There's going to be I think we're going to talk more and more about, over the next few years. I yeah.
I I just to stop you. I don't the question is what would you recommend? Right?
So it's not like if you would capture all of it, I think what if you if you are going to bring a drug to market, and it's gonna have to be you know, Oh, I mean, there's There's whole literature on I mean, it's it's it's it's a lot more complicated to explain, but you need to capture the lower grade symptomatic adverse events that patients are going to report, not only on your but also on the comparative drug, you need to collect the items in an unbiased manner.
So you're not favoring one or the other. And also include what we call the g p five, which is the fifth question on the fact g questionnaire that talks about overall border of adverse events because it has a recent paper shows it has very high predictability.
For patients dropping out of the study and also disease progression. So the more bother you have, the more likely you are going to drop out of the study or, short, worsening of your, of your cancer.
That's the core of the the tolerability issues, but then he also wants to know what's happening to physical functioning, what's happening to role functioning, Now these things don't change rapidly, and you don't have to access it every cycle or, frequently. You can't access it you know, I mean, and the agents and say that as well, you can you can measure those infrequently. Every third cycle, every second cycle maybe. But certainly you don't have to access it every every week. So but whereas the tolerability, you will know what you need to know within the first three, four cycles. So whether within the first three So, again, you don't have to assess tolerability throughout the study unless you have reason to believe that there are late emerging toxicity.
Anyway, that's I mean, I I don't wanna take too much time because the question q and a as well.
Oh, but I think that's super helpful, and I think, great. Great considerations, for anyone in his, in this space.
So let's let's take a look at the Q and A. I I I have it open here. So I think David was wondering are there benchmarks that we can look at in terms of of vulnerability?
And similar to health population benchmark and quality of of life.
I I mean, that's I mean, that this is a webinar.
I have a little bit.
Tolerability is a subjective, sort of concept. I mean, it's like does I mean, if you have there's no such thing as a clean drop, and people talk about, oh, you know, you know, we have a clean, but there there's no such thing. It's clean compared to something else. Okay, that that's how it is.
And so it something is more tolerable or there's evidence and there's no p value, by the way. There's evidence or the data suggest that something is more tolerable than the other. But until it goes into real world study, in in real world, and depending on whether patients are willing to carry on taking this drug, within the given the efficacy and safety. That's a real, real measure of tolerability.
But in within the clinical trial paradigm, there there is no benchmark that you want to get to. I mean, that would that that would be a very unfair thing to do.
So, yeah, I would add to that.
Like, I think, you know, tolerability of what? Like, what is the benchmark? Because tolerability, like, you know, hybrid proven is the if hybrid proven is the baseline or the benchmark, then clearly every other drug is basically to, do worse than that for the least of majority.
Yeah.
But And then I think that there was a question about quality of life.
And and and that's a that's a I mean, that's a good question. Let me share something, I have on on the screen. So So who who who was it that asked the question? Was it David did you say?
Yeah. I mean, David. So quality of life is a function of many, many things. Okay.
Hopefully, the culture of life, whether you are man, woman, young, old, really are coming from Asia or South America, what's your immediate environment, social, personality. So it's very difficult to say, you know, people talk about quality of life. And if I say, you know, today, I have a good quality of life, I know it's a good thing, but if you ask me to explain why I have a good quality of life. That's a very difficult thing for me to explain.
And there are one hundred and twenty some people on this webinar. And if I give a four by six car to each one of you and say, how would you describe quality of life? You will overcome up with a different definition.
Different cultures, spirituality, they all influence quality of life. So it's very difficult to this is why, I'm not a great fan of saying, you know, this study measure quality of life and shows improvement.
Well, that's only within that study.
Based on the patient, composition of that study. If you repeat the same study again, you know, different setup, you may not, get the same, same response. So quality of life is a very, broad domain, and this is why the FDA says that we will not give a label, based on quality of life. And you see less and less of that with EMA as well, especially with cancer studies, it used to we used to get, labels for health related quality of life.
Which based on the impairments and disease treatment and disability, of the patients, but again, we see less and less now even with the EMA. So it's it's a difficult, if people are beginning to catch on the fact that it's not an easy thing to measure and it. But although it's a it's a nice, catchy slogan when you say, why don't we demonstrate and improve quality of life? But we really don't know what that means.
Yeah. Yeah. It's it's a fascinating topic that when you truly, like, it becomes almost a philosophical question, of course, or what is what is quality of life? Yeah.
What I find fascinating is that very often, but I'm struggling to get the, to pull up the example in my head, but I've a few examples of where I did a twenty five, question, questionnaire was ultimately worse off than a single question and just said, like, how do you feel or, like, you know, is it better or worse, you know, something simple as that? But I guess we haven't we haven't, I mean, we're not gonna go in go into that, but we haven't found the true, the true answer yet. I think I have a question from Monique, which is interesting. She's basically saying, look, I work on university hospital. We do a ton of, prems and proms because, you know, we're probably based health care.
And then, she's saying, she she's not allowed or she's not in a position to reuse those questionnaires from, from the from the care setting in a research setting.
What are your what are your faults on that? Does that make sense? Because her position is that and that the setting is important for the research. So I think she's saying, well, I I measured this during the care process, which is what we will that we all care about. So why can't I reuse that data? What are your thoughts on that?
If I understand the question. So the right question is that I used in the care setting, why cannot we use that in the clinical trial? We search setting.
I think my immediate answer is the clinical trials are very controlled environments where patients get a very high grade care. Probably, and it may not pull pull your reflect, what you want to find. I heard. I heard someone saying, the clinician oncologist saying, last week that, you know, community, cancer center if two percent of the patients participate in in one clinical trial, the other ninety eight percent of patients get better care, purely because the investigators are getting used to, you know, they go to different conferences.
They are they are looking at the latest of whatever it is. And that's I think that's the it's it's to avoid that confounding. I think I think most likely, but I I don't know if it, what the internal reasons may be. Yeah.
I know. I agree. I think that's just the way we do things I would say is just we have highly structured trials because we're moving on ultimate, compatibility and limit biases as much as possible on the four you know, this is kind of uncontrolled data. I would say, I think it's still valuable as as sort of assesses real world data as I would say, like, an and I think in a real evidence setting, maybe even even more valuable.
Right? At least as part of a much bigger study. I think if you have a lot more data, we also have less of these issues, but we can't afford to run these randomized full trials at that scale. Mhmm.
But, you know, there's a lot of there's a lot of power in the data still, but that in a more real world setting.
Right.
So, sorry, the the these questions because it's a scientific topic.
The questions also get a little bit more complex. Yeah. So I think there's a question here on, just your thoughts on on BYOD quickly. You know, I think it's gonna we haven't really spoken about a a a loss. The question is basically, well, what if the patient is overloaded with ventilator instruments and diaries while having the ability to receive interruptive text messages from friends, family, and byrd.
So I guess the question is, like, though, do you get some kind of alert in a BYOD setting. Interesting way to look at it. I would Yeah.
I mean, the BYOD is a good idea, like many good ideas.
The there is I don't see a lot of uptake, on b o b y o e in cancer setting because there are many questions and people are not quite convinced that, VYOD setting. I mean, we have roughly, on average, between eighty and a hundred questions, in a typical kinds of study at at this stage.
And then on a daily basis, if you are measuring tolerability, you know, you can have up to twelve to fifteen items to complete.
On a weekly basis. That may be too much.
At least I think as well if I get if I'm gonna seek, I I I have to do this. So byod is a good idea and I think everyone thinks it's a good thing, but they are not convinced that it's got it works in clinical trials, effectively.
I have recently, had an example of BYOD that where there were only three questions that this is a cancer study. Three questions to compare to to for patients to respond to on a weekly basis. I think that's a that's a that's a reasonable that's a reasonable thing to I think so that that's what Yeah.
It's interesting. I mean, I've I've been, I'm definitely in the BYVcamp in terms of, where I see things going. I tend to kind of fast forward a little bit.
You know, I I also think that's, you know, we're gonna see true impact of wearable data once once we have enough standardization around BYOD wearables, which is gonna be difficult, but I think that's just ultimately, going to lead to the best quality evidence, but it may take a long time. I'll say on BYOD, there is quite a bit of scientific evidence that's, at least the data quality is is higher. But, again, I think we should pull this out into a another webinar and with the growth being our our science, our our scientific papers, but I do see that maybe sometimes it's just easier and cleaner to have your study device.
And you know, like, okay, if I'm going to touch this thing, I'm going to be stuck in a questionnaire for half an hour. I I can see that too, which would bring me to the point of, like, maybe these things shouldn't be so long. But, that's, a whole not a matter. Alright.
I think it's time to to wrap up. There's another question from from David on, tolerability, and compared to studies. So maybe, Ari, you can, take a look at that, async and answer that. I think for now, I will going to thank, the audience, for for their questions, and I'm mostly going to thank Ari for being an amazing, a guest, I hope everyone took something away from from this session.
And, yeah, we'll we'll do many more of So, we'll probably have I rebek, at some point. Thank you so much, Eric.
Thanks for inviting me there. Thank thank you everyone for joining the call. Thank you. Bye bye.
