US20050075832A1 - System and method for continuous data analysis of an ongoing clinical trial - Google Patents
System and method for continuous data analysis of an ongoing clinical trial Download PDFInfo
- Publication number
- US20050075832A1 US20050075832A1 US10/667,848 US66784803A US2005075832A1 US 20050075832 A1 US20050075832 A1 US 20050075832A1 US 66784803 A US66784803 A US 66784803A US 2005075832 A1 US2005075832 A1 US 2005075832A1
- Authority
- US
- United States
- Prior art keywords
- trial
- database
- statistical analysis
- data
- clinical trial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/20—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for electronic clinical trials or questionnaires
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H70/00—ICT specially adapted for the handling or processing of medical references
- G16H70/20—ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
Definitions
- This application relates to data processing of clinical trial data and more specifically a system and method for statistically analyzing the clinical trial data.
- Phase I a few research participants, referred to as subjects, (approximately 5 to 10) are used to determine toxicity of a new treatment.
- Phase II more subjects (10-20) are used to determine efficacy and further ascertain safety. Doses are stratified to try to gain information about the optimal portion.
- a treatment may be compared to either a placebo or another existing therapy.
- Phase III efficacy is determined. For this phase, more subjects on the order of hundreds to thousands of patients are needed to perform a meaningful statistical analysis.
- a treatment may be compared to either a placebo or another existing therapy.
- Phase IV post-approval study
- the treatment has already been approved by the FDA, but more testing is performed to evaluate long-term effects and to evaluate other indications.
- the study protocol is a document describing the reason for the experiment, the rationale for the number of subjects required, the methods used to study the subjects, and any other guidelines or rules for how the study is to be conducted. Prior to usage, the study protocol is reviewed and approved by an Institutional Review Board (IRB).
- IRB Institutional Review Board
- An IRB serves as a peer review group, which evaluates a protocol to determine its scientific soundness and ethics for the protection of the subjects and investigator.
- Subjects enrolled in a clinical study are stratified into groups that allow data to be assessed in a comparative fashion.
- one study arm known as a control group (or “control”)
- will use a placebo whereby a pill containing no active chemical ingredient is administered. In doing so, comparisons can be made between subjects receiving actual medication versus placebo.
- Subjects enrolled into a clinical study are assigned to a study arm in a random fashion, which is done to avoid biases that may occur in the selection of subjects for a trial. For example, a subject who is a particularly good candidate to respond to a new medication might be intentionally entered into the study arm to receive real medication and not a placebo. This could skew the data and outcome of the clinical trial to favor the medication under study, by the selection of subjects who are most likely to perform well with the medication. In instances where only one study group is present, randomization is not performed.
- Blinding is a process by which the study arm assignment for subjects in a clinical trial is not revealed to the subject (single blind) or to both the subject and the investigator (double blind). This minimizes the risk of data bias. Virtually all randomized trials are blinded by definition. In instances where only one study group is present, blinding is not performed.
- the database containing the completed trial data is shipped to a statistician for analysis. If particular occurrences, such as adverse events, are seen with an incidence that is greater in one group over another such that it exceeds the likelihood of pure chance alone, then it can be stated that statistical significance has been reached.
- the comparative incidence of any given occurrence between groups can be described by a numeric value, referred to as a “p-value”.
- a p-value of 1.0 indicates that there is a 100% likelihood that an incident occurred as the result of chance alone.
- a p-value of 0.0 indicates that there is a 0% likelihood that an incident occurred as a result of chance alone.
- values of p ⁇ 0.05 are considered to be “statistically significant”, and values of p ⁇ 0.01 are considered “highly statistically significant”.
- multiple study arms may not be utilized. In such cases, only a single study group exists with all subjects receiving the same treatment. This is typically performed when historical data about the medical treatment, or a competing treatment is already known from prior clinical trials, and may be utilized for the purpose of making comparisons.
- the objective of any clinical trial is to document the safety of a new treatment.
- this can be determined only as a result of analyzing and comparing the safety parameters of one study group to another.
- the study arm assignments are blinded, there is no way to separate out subjects and their data into corresponding groups for purposes of performing comparisons while the trial is being conducted. Since many clinical trials may last for time periods extending for years, it is conceivable to have a treatment toxicity go unnoticed for prolonged periods without intervention.
- any clinical trial seeking to document efficacy will incorporate key variables that are followed during the course of the trial to draw the desired conclusion.
- studies will define certain outcomes, or endpoints, at which point a study subject is considered to have completed the protocol.
- endpoints at which point a study subject is considered to have completed the protocol.
- statistical power refers to the probability of a test appropriately rejecting the null hypothesis, or the chance of an experiment's outcome being the result of chance alone.
- Clinical research protocols are engineered to prove a certain hypothesis about a medical treatment's safety and efficacy, and disprove the null hypothesis. To do so, statistical power is required, which can be achieved by obtaining a large enough sample size of subjects in each study arm. When too few subjects are enrolled into the study arms, there is the risk of the study not accruing enough subjects to enable the null hypothesis to be rejected, and thus not reaching statistical significance. Because clinical trials that are randomized are blinded, the actual number of subjects distributed throughout study arms is not defined until the end of the project. Although this maintains data collection integrity, there are inherent inefficiencies in the system, regardless of the outcome.
- a Data Safety Monitoring Board may be formed at the beginning of each protocol.
- a DSMB is recommended for clinical trials that involve a potentially serious outcome (e.g., death, heart attack, etc.), are randomized and blinded, and extend for prolonged periods of time.
- a DSMB is required for trials that are sponsored by the United States government, namely, the National Institute of Health (NIH).
- a DSMB generally consists of members who are domain experts in the field of study, such as physicians, as well as bio-statisticians. It is important that DSMB members be separate from personnel of the sponsor organization, and financial disclosure for all members is performed to minimize conflicts of interest.
- standard operating procedures are established for the DSMB, including the frequency of meetings, initiation of interim analyses, conduct during interim analyses and criteria for discontinuation of the clinical trial.
- DSMB functions to examine trends of adverse occurrences rather than investigate specific reports, which are generally left to each IRB responsible for the activities of any given investigator.
- FIG. 1 A typical method of collecting and analyzing patient data is illustrated in the flow chart shown in FIG. 1 .
- Patient data or charts 10 from the clinical trial are collected manually in paper forms.
- EDC Electronic Data Capture
- RDE Remote Data Entry
- a computer displays a Case Report Form (CRF) to a clinical research coordinator (CRC) 12 , typically a nurse or doctor.
- CRC 12 enters the patient data 10 through the computer display which is received in block 14 by an EDC system which executes all of the steps included in a box 11 .
- the received data is stored in a clinical trial database 38 through a link 20 which can be an electronic link such as a telephone line or Internet link.
- it is determined whether the data inputted by the CRC 12 is clean using one or more rules.
- the rules may be implemented by simple range checking scripts, or by an inference rule engine or deterministic rule engine in order to identify potential problems with the data.
- block 18 may also involve research personnel known as monitors or Clinical Research Associates (CRA) who travel to the various research sites to perform source document verification (SDV) whereby the data in the database 38 is reconciled against individual patient charts to the degree required in the protocol.
- CRA Clinical Research Associates
- SDV source document verification
- block 22 If it is determined that the data entered is not clean, then block 22 generates a query which is then sent over the link 20 to the CRC 12 .
- the blocks 14 , 18 and 22 are repeated until all of the subject data 10 are entered. This is an iterative process that continues until resolution of all queries in the database 38 .
- block 24 determines whether the clinical trial is over. If no, then the EDC system continues to receive the patient trial data 10 through block 14 as the trial continues. If the trial is over, control passes to block 26 where the entire database is locked from any changes, deletions or insertions of the data in the database 38 . In one embodiment, locking involves turning the database 38 into a “read-only” state.
- a blinding data from a blinding database is retrieved.
- a simplified example blinding database 40 is shown in FIG. 4 .
- the blinding database 40 is a database table having two columns. The first column contains a patient subject ID (subject identifier) and the second column contains an associated study arm or group the patient belongs to. In the table 40 , 13 subjects belong to Study Arm “A” and 12 subjects belong to Study Arm “B”. Because the database 40 is not associated with actual trial data, the table 40 by itself is relatively uninformative.
- a simplified example trial database 38 is shown in FIG. 5 .
- the embodiment shown is a database table containing two columns.
- the first column contains a patient subject ID and the second column is a database field called “Heart Attack” which specifies whether the subject had a heart attack.
- An entry of 0 means NO and entry of 1 means YES.
- the trial database 38 due to blinding of the subjects in the study groups, there is no way of knowing whether or not any discrepancy exists in the number of heart attacks seen in Group A versus B. Because the trial is randomized, without the blinding data 40 , the table 38 by itself is relatively uninfomative.
- an unblinded database is produced from the trial database 38 and the retrieved blinding database 40 in which the subject ID is used as a common key.
- the result of the unblinding process of block 28 is shown in FIG. 6 as the unblinded database 41 .
- one database table is produced.
- the table 41 contains subject identifiers, Study Arm of the subjects, and Heart Attack data of those subjects. As can be appreciated by a person of ordinary skill in the art, there is a direct traceability from study data and subject ID to Study Arm.
- An interim analysis may be conducted.
- An interim analysis may result from urging of the DSMB for cause, or be a pre-planned event as described in the study protocol.
- Conducting an interim analysis involves a process where the available data is verified and cleaned.
- the verification process generally involves a process by which trained personnel travel to the various research sites to reconcile submitted data against source documents, which generally implies the patient's chart, laboratory reports, radiographic readings, and others.
- the data cleaning process may involve a series of documented communications between the research site and a central data coordinating personnel to resolve inconsistencies or other conflicting data.
- the refined database must then be sent to an impartial third party for statistical analysis.
- the statistician must un-blind the clinical trial database by combining both the study data with the blinding key of which subjects are assigned to particular study arms. Since the clinical study is expected to continue beyond the interim analysis, the process of un-blinding must be conducted with great caution, so as not to reveal the blind status of subjects to any personnel involved in the execution of the clinical trial. Once a statistician has completed the interim analysis, a report is issued to the trial sponsor and DSMB.
- a system and method of continuously analyzing trial data of an ongoing clinical trial is provided.
- a trial database containing subject trial data in a clinical trial is accessed, and a statistical analysis is performed on the accessed trial database. If the result of the statistical analysis does not exceed a predetermined threshold value, then the step of statistical analysis is repeated while the clinical trial is ongoing.
- the present method uses a user definable criteria that defines the level of cleanliness of subject data for statistical analysis. In that case, only those subject data that meet the user defined criteria are selected from the trial database for statistical analysis.
- the analysis program waits for a predetermined time period prior to repeating the statistical analysis step. This is done so that additional subject data are added to the trial database.
- the clinical trial is blinded.
- a blinding database containing subject identifiers and associated study group identifiers is accessed.
- Each study group identifier identifies which study group an associated subject belongs to.
- a grouped database is produced from the clinical database and the blinding database for statistical analysis in which the grouped database groups trial data according to the study group the subjects belong to.
- one data table is created for each study group and contains all trial data for those subjects that belong to that study group.
- the unblinded database is stored in a memory device that is inaccessible by any user in order to preserve the blindness of the trial.
- the statistical analysis is performed without locking the trial database.
- the predetermined threshold value may include a predetermined statistical significance value.
- a user selectable statistical model is retrieved and the retrieved model is run on the trial database.
- FIG. 1 is a flow diagram of a method of collecting and analyzing clinical trial data using an EDC system.
- FIG. 2 is a functional block diagram of a clinical trial management system according to an exemplary embodiment of the present invention.
- FIG. 3 is a flow diagram of a software routine that continuously analyzes the trial data while the trial is ongoing according to the present invention.
- FIG. 4 is an example of a blinding database.
- FIG. 5 is an example of a trial database containing subject trial data.
- FIG. 6 is an example of an unblinded database derived from the blinding database of FIG. 4 and the trial database of FIG. 5 .
- FIG. 7A is an example of a trial database containing a status field that represents the levels of cleanliness of the subject data records.
- FIG. 7B is a filtered trial database containing a subset of the trial database of FIG. 7A which have been selected according to a user specified status.
- FIG. 8 is an example of a grouped database derived from the blinding database of FIG. 4 and the filtered trial database of FIG. 7B .
- a clinical trial data management system 100 of the present invention is an Internet-enabled application solution framework that automates data collection, data cleaning, grouping if needed (as will be explained more fully later herein) and statistical data analysis while the trial is ongoing.
- the system 100 is connected to a computer network such as the Internet 120 through, for example, an I/O interface 102 , which receives information from and sends information to Internet users over a communication link 20 and to one or more operators using a work station 117 .
- the Internet users are typically CRC's located at various trial sites who transcribe the subjects' charts to the system 100 .
- the system 100 includes, for example, memory 104 which is volatile, processor (CPU) 106 , program storage 108 , and data storage device 118 , all commonly connected to each other through a bus 112 .
- the program storage 108 stores, among others, a clinical trial analysis program or module 114 and one or more mathematical models 116 that are used to analyze the subject data and obtain the p-value for statistical significance.
- the data storage device 118 stores a clinical trial database 38 and blinding database 40 . Any of the software program modules in the program storage 108 and data from the data storage 110 are transferred to the memory 104 as needed and is executed by the processor 106 .
- the system 100 can be any computer such as a WINDOWS-based or UNIX-based personal computer, server, workstation, minicomputer or a mainframe, or a combination thereof. While the system 100 is illustrated as a single computer unit for purposes of clarity, persons of ordinary skill in the art will appreciate that the system may comprise a group of computers which can be scaled depending on the processing load and database size.
- FIG. 3 illustrates a flow diagram of a software routine 50 that continuously analyzes the trial data while the trial is ongoing according to the present invention.
- the routine 50 is stored in the storage device 108 and works with the EDC system 11 of FIG. 1 while the system 11 continuously collects and cleans the trial data.
- the routine 50 connects to a trial database 56 through a log-in procedure.
- a simplified trial database 56 is shown in FIG. 7A .
- the database 56 contains three columns comprising a patient subject ID field, a data status field, which specifies the level of cleanliness, and a “Heart Attack” field similar to FIG. 5 .
- FIG. 7A illustrates simplified trial data records that are at different levels of cleanliness.
- Level 1 indicates that there is an outstanding query that needs to be answered by the CRC 12 (see step 22 in FIG. 1 ).
- Level 2 indicates that the record is pending a review by another reviewer such as the sponsor of the trial.
- Level 3 indicates that it is pending a review by a clinical research associate (CRA) to travel to a research site to perform what is known as a source document verification (SDV). This typically involves a verification of the trial record with an actual patient chart.
- Level 4 indicates that it is pending a lock barring any intervention by any reviewer.
- Level 5 indicates that the record is locked which represents the highest level of clean data.
- CRA clinical research associate
- SDV source document verification
- the “Heart Attack” field also includes some erroneous data such as “don't know” for subject 118 or “Y” for subject 107 . Accordingly, the status for those records indicates a “1” in which queries are outstanding.
- the routine 50 retrieves in block 60 a user specified criteria 54 stored in the storage device 108 which specifies the status or level of cleanliness of the trial database and in block 61 retrieves the trial database 56 which is filtered for those database records that satisfy the retrieved criteria. For an example, if the retrieved user specified criteria is 3, block 61 selects only those records that have a status of 3 or better.
- Such a filtered database 58 is shown in FIG. 7B . While the database 58 has a relatively higher level of cleanliness, it does have a fewer number of records. This is useful since, at any given point in time during the data collection process, the clinical trial database 56 may have data that has any combination of data pending SDV, containing outstanding queries, completed SDV but awaiting lock, and so on. Depending upon the operating procedures defined for any such clinical trial, only certain subsets of data may be suitable for inclusion in an analysis.
- block 62 is executed.
- the blinding database 40 is retrieved in the memory 104 .
- the filtered trial database 58 and the blinding database 40 are used to produce a grouped database 42 .
- two database tables 66 , 68 are produced.
- One table 66 groups the Heart Attack data of subjects that belong to a control group (Study Arm A) while the other table 68 groups the Heart Attack data of subjects that belong to a non-control group (Study Arm B).
- the trial is a randomized clinical trial.
- the system 100 maintains the clinical trial database 38 and the blinding database 40 as separate physical and digital entities, in order to maintain their distinct nature.
- the trial data and blind data remain as two separate data tables and no table is created where the subject identifier, study group and heart attack status would all be found in that same table.
- system communication with the blinding database table occurs only by virtue of the machine programs executing specified actions to sort the clinical trial data.
- the clinical trial data in this scenario is preferably segregated into generic pools of data and remains de-identified to both the subject and the study arm, and thus indecipherable from the standpoint of the ability to trace a particular data item back to a specific subject.
- the blinding table 40 transferred into an area of the system where the table is accessible by any user or displayed in any form of output. This maintains the integrity and confidentiality of the blinding information.
- the routine retrieves a user defined analysis method 72 stored in the storage device 108 and retrieves the method from the mathematical models 116 stored in the storage device.
- the model is then run to analyze the grouped database 42 .
- a statistical significance of the safety and efficacy of the unblinded database known as p-value is obtained.
- the mathematical model may include one or more formulas, representing mathematical calculations, whereby one or more variables in the clinical trial database are identified, and numeric result may be obtained. Such formulas might include calculations of: mean, median, mode, range, average deviation, standard deviation, and variance.
- an administrator may enter mathematical formulas to further analyze the data to make comparisons between groups of data, as defined by the study arms, to determine statistical metrics and significance by methods including Chi-square analysis, t-test, f-test, one-tailed test, two-tailed test, and Analysis of Variance (ANOVA).
- a user-defined p-value 74 stored in the storage device 108 is retrieved in block 76 .
- a typical user defined p-value used may be 0.05 meaning that the difference between the control group and non-control group is statistically significant. Thus, if the derived value is less than 0.05, the decision in block 78 is YES. Then, the routine send an alert in block 80 without displaying the actual output value(s).
- the alert can be in the form of a flashing display, alarm, a change in the system output display to the user by virtue of color-coding, fonts, icons or text, or an automated system generated message to the user by way of email, facsimile, telephone or pager.
- the routine can also create other outputs such as the generic data tables 66 , 68 created in block 64 .
- the output data could take various formats including plain text, American Standard Code for Information Interchange (ASCII), and SAS. Where appropriate, this would allow for more customized statistical analysis to be performed.
- ASCII American Standard Code for Information Interchange
- SAS SAS
- Block 80 provides a Boolean output as to whether or not a particular study parameter has reached the desired level of statistical significance or not. Block 82 in that case is then skipped.
- the benefit of such a mode is to maintain the blinding information as securely as possible, and minimize the ability for inference to be made about the study arm of any given subject.
- the accession of new data could cause statistical metrics for a particular study arm to change in such a manner that inference could be made regarding the blinding status of the subject whose data was most recently added, thus compromising statistical veil.
- Block 80 may be useful in non-randomized trials because there is a benefit to display the specific numeric value corresponding to statistical significance, and since there is no blinding information to protect, it would be offered as a second mode of operation in the system.
- a third mode could be provided, whereby numeric ranges of statistical significance could be defined into groups that would be output to the user of the system.
- the routine 50 executes block 86 .
- the routine 50 waits for a predetermined amount of time and control passes to block 52 where the process of analyzing the trial data while the trial is ongoing is repeated.
- the system 100 is active throughout the data collection phase of the clinical trial, sending alerts when key parameters reach the pre-set level of statistical measure.
- the ability of the present clinical trial system 100 to continuously and confidentially monitor and analyze the trial data for statistical significance in tandem with data collection while the trial is ongoing is a tremendous benefit to the researchers.
- the trial database no longer becomes the bottleneck in obtaining useful results and statistical analysis can be conducted on a near real-time basis.
- the present invention shortens the time frame required to reach critical decisions about a new medical therapy. Still another advantage is that the present system improves patient safety by setting thresholds for triggering alerts for adverse events. A related advantage is that a futile trial can be ended early, thereby saving the substantial cost of conducting the trial. Conversely, for a successful medical treatment, a trial can be ended early or the placebo arm can be eliminated.
- the present invention also provides the ability to more accurately identify the need to perform a full-scale interim analysis.
Abstract
Description
- This application relates to data processing of clinical trial data and more specifically a system and method for statistically analyzing the clinical trial data.
- In the United States, the Food and Drug Administration (FDA) oversees the protection of consumers exposed to health-related products ranging from food, cosmetics, drugs, gene therapies and medical devices. Under the FDA guidance, clinical trials are performed to test the safety and efficacy of new drugs, medical devices or other treatments to ultimately ascertain whether or not a new medical therapy is appropriate for widespread human consumption.
- More specifically, once a new drug or medical device has undergone studies in animals, and results appear favorable, it can be studied in humans. Before human testing is begun, findings of animal studies are reported to the FDA to obtain approval to do so. This report to the FDA is called an application for an Investigational New Drug (IND).
- The process of experimentation is referred to as a clinical trial, which involves four phases. In Phase I, a few research participants, referred to as subjects, (approximately 5 to 10) are used to determine toxicity of a new treatment. In Phase II, more subjects (10-20) are used to determine efficacy and further ascertain safety. Doses are stratified to try to gain information about the optimal portion. A treatment may be compared to either a placebo or another existing therapy. In Phase III, efficacy is determined. For this phase, more subjects on the order of hundreds to thousands of patients are needed to perform a meaningful statistical analysis. A treatment may be compared to either a placebo or another existing therapy. In Phase IV (post-approval study), the treatment has already been approved by the FDA, but more testing is performed to evaluate long-term effects and to evaluate other indications.
- During clinical trials, patients are seen at medical clinics and asked to participate in a clinical research project by their doctor, known as an investigator. After the patients sign an informed consent form, they are considered enrolled in the study, and are subsequently referred to as study subjects. A study sponsor, generally considered to be the company developing a new medical treatment and supporting the research, develops a study protocol. The study protocol is a document describing the reason for the experiment, the rationale for the number of subjects required, the methods used to study the subjects, and any other guidelines or rules for how the study is to be conducted. Prior to usage, the study protocol is reviewed and approved by an Institutional Review Board (IRB). An IRB serves as a peer review group, which evaluates a protocol to determine its scientific soundness and ethics for the protection of the subjects and investigator.
- Creation of Study Groups (Study Arms)
- Subjects enrolled in a clinical study are stratified into groups that allow data to be assessed in a comparative fashion. In a common example, one study arm, known as a control group (or “control”), will use a placebo, whereby a pill containing no active chemical ingredient is administered. In doing so, comparisons can be made between subjects receiving actual medication versus placebo.
- Randomization
- Subjects enrolled into a clinical study are assigned to a study arm in a random fashion, which is done to avoid biases that may occur in the selection of subjects for a trial. For example, a subject who is a particularly good candidate to respond to a new medication might be intentionally entered into the study arm to receive real medication and not a placebo. This could skew the data and outcome of the clinical trial to favor the medication under study, by the selection of subjects who are most likely to perform well with the medication. In instances where only one study group is present, randomization is not performed.
- Blinding
- Blinding is a process by which the study arm assignment for subjects in a clinical trial is not revealed to the subject (single blind) or to both the subject and the investigator (double blind). This minimizes the risk of data bias. Virtually all randomized trials are blinded by definition. In instances where only one study group is present, blinding is not performed.
- Statistical Analysis of Trial Data
- Generally, at the end of the trial, the database containing the completed trial data is shipped to a statistician for analysis. If particular occurrences, such as adverse events, are seen with an incidence that is greater in one group over another such that it exceeds the likelihood of pure chance alone, then it can be stated that statistical significance has been reached. Using statistical calculations, the comparative incidence of any given occurrence between groups can be described by a numeric value, referred to as a “p-value”. A p-value of 1.0 indicates that there is a 100% likelihood that an incident occurred as the result of chance alone. Conversely, a p-value of 0.0 indicates that there is a 0% likelihood that an incident occurred as a result of chance alone. Generally, values of p<0.05 are considered to be “statistically significant”, and values of p<0.01 are considered “highly statistically significant”.
- In some clinical trials, multiple study arms, or even a control group, may not be utilized. In such cases, only a single study group exists with all subjects receiving the same treatment. This is typically performed when historical data about the medical treatment, or a competing treatment is already known from prior clinical trials, and may be utilized for the purpose of making comparisons.
- The creation of study arms, randomization, and blinding are techniques that are used in most clinical trials where scientific rigor is of high importance. However, these methods lead to several challenges, since they prevent the clinical trial sponsor from tracking key information related to safety and efficacy.
- Regarding safety, the objective of any clinical trial is to document the safety of a new treatment. However, in clinical trials where randomization is conducted between two or more study arms, this can be determined only as a result of analyzing and comparing the safety parameters of one study group to another. Unfortunately, because the study arm assignments are blinded, there is no way to separate out subjects and their data into corresponding groups for purposes of performing comparisons while the trial is being conducted. Since many clinical trials may last for time periods extending for years, it is conceivable to have a treatment toxicity go unnoticed for prolonged periods without intervention.
- Regarding efficacy, any clinical trial seeking to document efficacy will incorporate key variables that are followed during the course of the trial to draw the desired conclusion. In addition, studies will define certain outcomes, or endpoints, at which point a study subject is considered to have completed the protocol. These parameters, including both key variables and study endpoints, cannot be analyzed by comparison between study arms while the subjects are randomized and blinded. This poses potential problems in ethics and statistical analysis.
- When new medications or other health-related treatments are of superior efficacy to anything else, it is ethical to allow usage of the treatment for those in imminent need, even prior to final government approval. Conversely, when available, it is considered unethical to withhold such treatments. For example, if a medication were to be identified that eradicated the Human Immunodeficiency Virus (HIV), it would be unethical to allow diseased patients to continue suffering and even die of the illness, while the medication was being clinically tested for purposes of government approval. Ideally, in such situations, identification of effective treatments should occur early in the project. Under these circumstances, non-treatment arms (i.e., those taking placebos) could be construed as unethical and should be eliminated. At present, when clinical trials are randomized and blinded, identification of a particularly effective treatment may not be realized until the entire clinical trial is completed.
- Another related problem is statistical power. By definition, statistical power refers to the probability of a test appropriately rejecting the null hypothesis, or the chance of an experiment's outcome being the result of chance alone. Clinical research protocols are engineered to prove a certain hypothesis about a medical treatment's safety and efficacy, and disprove the null hypothesis. To do so, statistical power is required, which can be achieved by obtaining a large enough sample size of subjects in each study arm. When too few subjects are enrolled into the study arms, there is the risk of the study not accruing enough subjects to enable the null hypothesis to be rejected, and thus not reaching statistical significance. Because clinical trials that are randomized are blinded, the actual number of subjects distributed throughout study arms is not defined until the end of the project. Although this maintains data collection integrity, there are inherent inefficiencies in the system, regardless of the outcome.
- In a case where the study data reaches statistical significance, as accrual of subjects continues, and data is received, an optimal time to close a clinical study would be at the very moment when statistical significance is achieved. While that moment may arrive earlier in the course of a clinical trial, there is no way of knowing this, and therefore time and money are lost. Moreover, study subjects are enrolled above and beyond what is needed to reach the goals of the study, thus placing human subjects under experimentation unnecessarily.
- In a case where the study data nearly reaches statistical significance, while the study data falls short of statistical significance, there is reason to believe that this is due to a shortage of enrollment in the study. Frequently, to develop more supportive data, clinical trials will be extended. These “extension studies”, however, can only begin after a full closure of the parent study, frequently requiring months to years before starting again.
- In a case where the study data does not reach statistical significance, there is no trend toward significance, and there is little chance of reaching the desired conclusion. In that case, an optimal time to close a study is as early as possible once the conclusion can be established that the treatment under investigation does not work, and study data has little chance of reaching statistical significance (i.e., it is futile). In randomized and blinded clinical trials, this conclusion is difficult to arrive at until data analysis can be conducted. In these situations, time and money are lost. Moreover, an excess of human subjects are placed under study unnecessarily.
- Data Safety Monitoring
- To mitigate some of the risks related to the conduct of randomized and blinded clinical trials, a Data Safety Monitoring Board (DSMB) may be formed at the beginning of each protocol. In general, a DSMB is recommended for clinical trials that involve a potentially serious outcome (e.g., death, heart attack, etc.), are randomized and blinded, and extend for prolonged periods of time. In addition, a DSMB is required for trials that are sponsored by the United States government, namely, the National Institute of Health (NIH).
- A DSMB generally consists of members who are domain experts in the field of study, such as physicians, as well as bio-statisticians. It is important that DSMB members be separate from personnel of the sponsor organization, and financial disclosure for all members is performed to minimize conflicts of interest. Prior to start of a clinical trial, standard operating procedures are established for the DSMB, including the frequency of meetings, initiation of interim analyses, conduct during interim analyses and criteria for discontinuation of the clinical trial. As it relates to the safety of study subjects, DSMB functions to examine trends of adverse occurrences rather than investigate specific reports, which are generally left to each IRB responsible for the activities of any given investigator.
- Data Collection
- A typical method of collecting and analyzing patient data is illustrated in the flow chart shown in
FIG. 1 . Patient data orcharts 10 from the clinical trial are collected manually in paper forms. Using a technology called Electronic Data Capture (EDC) or Remote Data Entry (RDE), a computer (not shown) displays a Case Report Form (CRF) to a clinical research coordinator (CRC) 12, typically a nurse or doctor. TheCRC 12 then enters thepatient data 10 through the computer display which is received inblock 14 by an EDC system which executes all of the steps included in abox 11. The received data is stored in aclinical trial database 38 through alink 20 which can be an electronic link such as a telephone line or Internet link. Inblock 18, it is determined whether the data inputted by theCRC 12 is clean using one or more rules. The rules may be implemented by simple range checking scripts, or by an inference rule engine or deterministic rule engine in order to identify potential problems with the data. - In addition to the software programs, block 18 may also involve research personnel known as monitors or Clinical Research Associates (CRA) who travel to the various research sites to perform source document verification (SDV) whereby the data in the
database 38 is reconciled against individual patient charts to the degree required in the protocol. - If it is determined that the data entered is not clean, then block 22 generates a query which is then sent over the
link 20 to theCRC 12. Theblocks subject data 10 are entered. This is an iterative process that continues until resolution of all queries in thedatabase 38. - Once all
data 10 are entered, block 24 determines whether the clinical trial is over. If no, then the EDC system continues to receive thepatient trial data 10 throughblock 14 as the trial continues. If the trial is over, control passes to block 26 where the entire database is locked from any changes, deletions or insertions of the data in thedatabase 38. In one embodiment, locking involves turning thedatabase 38 into a “read-only” state. - In
block 28, a blinding data from a blinding database is retrieved. A simplifiedexample blinding database 40 is shown inFIG. 4 . Theblinding database 40 is a database table having two columns. The first column contains a patient subject ID (subject identifier) and the second column contains an associated study arm or group the patient belongs to. In the table 40, 13 subjects belong to Study Arm “A” and 12 subjects belong to Study Arm “B”. Because thedatabase 40 is not associated with actual trial data, the table 40 by itself is relatively uninformative. - A simplified
example trial database 38 is shown inFIG. 5 . The embodiment shown is a database table containing two columns. The first column contains a patient subject ID and the second column is a database field called “Heart Attack” which specifies whether the subject had a heart attack. An entry of 0 means NO and entry of 1 means YES. As can be seen from thetrial database 38, due to blinding of the subjects in the study groups, there is no way of knowing whether or not any discrepancy exists in the number of heart attacks seen in Group A versus B. Because the trial is randomized, without theblinding data 40, the table 38 by itself is relatively uninfomative. - In
block 28, an unblinded database is produced from thetrial database 38 and the retrievedblinding database 40 in which the subject ID is used as a common key. The result of the unblinding process ofblock 28 is shown inFIG. 6 as the unblindeddatabase 41. In the embodiment shown, one database table is produced. The table 41 contains subject identifiers, Study Arm of the subjects, and Heart Attack data of those subjects. As can be appreciated by a person of ordinary skill in the art, there is a direct traceability from study data and subject ID to Study Arm. - In
block 30, statistical analysis is performed on the unblindeddata 42 to find out the efficacy and safety of the completed clinical trial. - During the course of any given randomized and blinded clinical trial, an interim analysis may be conducted. An interim analysis may result from urging of the DSMB for cause, or be a pre-planned event as described in the study protocol.
- Conducting an interim analysis involves a process where the available data is verified and cleaned. The verification process generally involves a process by which trained personnel travel to the various research sites to reconcile submitted data against source documents, which generally implies the patient's chart, laboratory reports, radiographic readings, and others. The data cleaning process may involve a series of documented communications between the research site and a central data coordinating personnel to resolve inconsistencies or other conflicting data.
- The refined database must then be sent to an impartial third party for statistical analysis. To conduct the analysis, the statistician must un-blind the clinical trial database by combining both the study data with the blinding key of which subjects are assigned to particular study arms. Since the clinical study is expected to continue beyond the interim analysis, the process of un-blinding must be conducted with great caution, so as not to reveal the blind status of subjects to any personnel involved in the execution of the clinical trial. Once a statistician has completed the interim analysis, a report is issued to the trial sponsor and DSMB.
- Inclusive of the data cleaning, verification, un-blinding and statistical analysis processes, as well as the administrative resources for coordinating several groups of personnel for the un-blinding process, an interim analysis is often arduous, time-consuming and expensive.
- In spite of the latest technological advancements made in the area of data collection through electronic systems, there is still a disadvantage in that it is very difficult to draw conclusions about a medical treatment while the data is being collected during the trial. This limitation stems primarily from the fact that statistical analysis cannot begin until the trial data has been fully cleaned and processed. At present, statistical analysis can only be conducted upon data in an “en bloc” fashion. This creates a situation where the ability to draw conclusions about a medical therapy inevitably lags behind the process of simply obtaining data in a database.
- Regardless of how efficient the data collection process may be made through automation, the ability to acquire the information needed for critical decision-making is still suspended by the requirement to obtain a locked database in order for statistical work to advance.
- Therefore, it is desirable to provide a method and system for conducting statistical analysis on the clinical data collected while the trial is ongoing.
- In the case of a randomized clinical trial where maintaining confidentiality is important, it is also desirable to provide a secure system in which the blinding information is integrated in such a way that the clinical trial data and blinding data are stored securely to prevent users from accessing the data and yet allow the execution of programs for performing statistical comparisons between study arms while the trial is ongoing.
- According to the present invention, a system and method of continuously analyzing trial data of an ongoing clinical trial is provided. A trial database containing subject trial data in a clinical trial is accessed, and a statistical analysis is performed on the accessed trial database. If the result of the statistical analysis does not exceed a predetermined threshold value, then the step of statistical analysis is repeated while the clinical trial is ongoing.
- In another aspect of the invention, the present method uses a user definable criteria that defines the level of cleanliness of subject data for statistical analysis. In that case, only those subject data that meet the user defined criteria are selected from the trial database for statistical analysis.
- In another aspect of the invention, when the result of the statistical analysis does not exceed the predetermined threshold value, then the analysis program waits for a predetermined time period prior to repeating the statistical analysis step. This is done so that additional subject data are added to the trial database.
- In another aspect, the clinical trial is blinded. Accordingly, in addition to the trial database, a blinding database containing subject identifiers and associated study group identifiers is accessed. Each study group identifier identifies which study group an associated subject belongs to. Then a grouped database is produced from the clinical database and the blinding database for statistical analysis in which the grouped database groups trial data according to the study group the subjects belong to. Preferably, one data table is created for each study group and contains all trial data for those subjects that belong to that study group.
- In yet another aspect of the search, the unblinded database is stored in a memory device that is inaccessible by any user in order to preserve the blindness of the trial.
- In another aspect of the search, the statistical analysis is performed without locking the trial database.
- In another aspect of the search, if the result of the statistical analysis exceeds the predetermined threshold value, a user is alerted. The predetermined threshold value may include a predetermined statistical significance value.
- In another aspect of the search, there are many statistical models to choose from. A user selectable statistical model is retrieved and the retrieved model is run on the trial database.
-
FIG. 1 is a flow diagram of a method of collecting and analyzing clinical trial data using an EDC system. -
FIG. 2 is a functional block diagram of a clinical trial management system according to an exemplary embodiment of the present invention. -
FIG. 3 is a flow diagram of a software routine that continuously analyzes the trial data while the trial is ongoing according to the present invention. -
FIG. 4 is an example of a blinding database. -
FIG. 5 is an example of a trial database containing subject trial data. -
FIG. 6 is an example of an unblinded database derived from the blinding database ofFIG. 4 and the trial database ofFIG. 5 . -
FIG. 7A is an example of a trial database containing a status field that represents the levels of cleanliness of the subject data records. -
FIG. 7B is a filtered trial database containing a subset of the trial database ofFIG. 7A which have been selected according to a user specified status. -
FIG. 8 is an example of a grouped database derived from the blinding database ofFIG. 4 and the filtered trial database ofFIG. 7B . - As shown in
FIG. 2 , a clinical trialdata management system 100 of the present invention is an Internet-enabled application solution framework that automates data collection, data cleaning, grouping if needed (as will be explained more fully later herein) and statistical data analysis while the trial is ongoing. Thesystem 100 is connected to a computer network such as theInternet 120 through, for example, an I/O interface 102, which receives information from and sends information to Internet users over acommunication link 20 and to one or more operators using awork station 117. The Internet users are typically CRC's located at various trial sites who transcribe the subjects' charts to thesystem 100. Thesystem 100 includes, for example,memory 104 which is volatile, processor (CPU) 106,program storage 108, anddata storage device 118, all commonly connected to each other through abus 112. Theprogram storage 108 stores, among others, a clinical trial analysis program ormodule 114 and one or moremathematical models 116 that are used to analyze the subject data and obtain the p-value for statistical significance. Thedata storage device 118 stores aclinical trial database 38 and blindingdatabase 40. Any of the software program modules in theprogram storage 108 and data from thedata storage 110 are transferred to thememory 104 as needed and is executed by theprocessor 106. - The
system 100 can be any computer such as a WINDOWS-based or UNIX-based personal computer, server, workstation, minicomputer or a mainframe, or a combination thereof. While thesystem 100 is illustrated as a single computer unit for purposes of clarity, persons of ordinary skill in the art will appreciate that the system may comprise a group of computers which can be scaled depending on the processing load and database size. -
FIG. 3 illustrates a flow diagram of asoftware routine 50 that continuously analyzes the trial data while the trial is ongoing according to the present invention. The routine 50 is stored in thestorage device 108 and works with theEDC system 11 ofFIG. 1 while thesystem 11 continuously collects and cleans the trial data. - In
block 52, the routine 50 connects to atrial database 56 through a log-in procedure. Asimplified trial database 56 is shown inFIG. 7A . Thedatabase 56 contains three columns comprising a patient subject ID field, a data status field, which specifies the level of cleanliness, and a “Heart Attack” field similar toFIG. 5 . -
FIG. 7A illustrates simplified trial data records that are at different levels of cleanliness. In the example shown inFIG. 7A , there are five levels of status.Level 1 indicates that there is an outstanding query that needs to be answered by the CRC 12 (seestep 22 inFIG. 1 ). Level 2 indicates that the record is pending a review by another reviewer such as the sponsor of the trial.Level 3 indicates that it is pending a review by a clinical research associate (CRA) to travel to a research site to perform what is known as a source document verification (SDV). This typically involves a verification of the trial record with an actual patient chart.Level 4 indicates that it is pending a lock barring any intervention by any reviewer. Finally,Level 5 indicates that the record is locked which represents the highest level of clean data. - In the “Heart Attack” field, an entry of 0 means NO and entry of 1 means YES. The “Heart Attack” field also includes some erroneous data such as “don't know” for
subject 118 or “Y” forsubject 107. Accordingly, the status for those records indicates a “1” in which queries are outstanding. - Once connected, the routine 50 retrieves in block 60 a user specified
criteria 54 stored in thestorage device 108 which specifies the status or level of cleanliness of the trial database and inblock 61 retrieves thetrial database 56 which is filtered for those database records that satisfy the retrieved criteria. For an example, if the retrieved user specified criteria is 3, block 61 selects only those records that have a status of 3 or better. Such a filtereddatabase 58 is shown inFIG. 7B . While thedatabase 58 has a relatively higher level of cleanliness, it does have a fewer number of records. This is useful since, at any given point in time during the data collection process, theclinical trial database 56 may have data that has any combination of data pending SDV, containing outstanding queries, completed SDV but awaiting lock, and so on. Depending upon the operating procedures defined for any such clinical trial, only certain subsets of data may be suitable for inclusion in an analysis. - Once the database 39 is filtered according to the user specified criteria, block 62 is executed. In
block 62, theblinding database 40 is retrieved in thememory 104. Inblock 64, the filteredtrial database 58 and theblinding database 40 are used to produce a groupeddatabase 42. In the embodiment shown, two database tables 66, 68, one for each study group without identifying subjects, are produced. One table 66 groups the Heart Attack data of subjects that belong to a control group (Study Arm A) while the other table 68 groups the Heart Attack data of subjects that belong to a non-control group (Study Arm B). As can be appreciated by person of ordinary skill in the art, there is no way to trace the origins of any given data point in either table 66 or table 68, to its original subject, and therefore either table, by itself, is relatively uninformative. Taken together, however, note that there seems to be a lot more heart attacks occurring in Study Arm B. - In the embodiment shown in
FIG. 3 , the trial is a randomized clinical trial. In that embodiment, thesystem 100 maintains theclinical trial database 38 and theblinding database 40 as separate physical and digital entities, in order to maintain their distinct nature. In other words, the trial data and blind data remain as two separate data tables and no table is created where the subject identifier, study group and heart attack status would all be found in that same table. Furthermore, system communication with the blinding database table occurs only by virtue of the machine programs executing specified actions to sort the clinical trial data. The clinical trial data in this scenario is preferably segregated into generic pools of data and remains de-identified to both the subject and the study arm, and thus indecipherable from the standpoint of the ability to trace a particular data item back to a specific subject. At no point during system function is the blinding table 40 transferred into an area of the system where the table is accessible by any user or displayed in any form of output. This maintains the integrity and confidentiality of the blinding information. - In
block 70, the routine retrieves a user definedanalysis method 72 stored in thestorage device 108 and retrieves the method from themathematical models 116 stored in the storage device. The model is then run to analyze the groupeddatabase 42. Preferably, a statistical significance of the safety and efficacy of the unblinded database known as p-value is obtained. The mathematical model may include one or more formulas, representing mathematical calculations, whereby one or more variables in the clinical trial database are identified, and numeric result may be obtained. Such formulas might include calculations of: mean, median, mode, range, average deviation, standard deviation, and variance. In addition, an administrator may enter mathematical formulas to further analyze the data to make comparisons between groups of data, as defined by the study arms, to determine statistical metrics and significance by methods including Chi-square analysis, t-test, f-test, one-tailed test, two-tailed test, and Analysis of Variance (ANOVA). - Once the mathematical analysis is completed, a user-defined p-
value 74 stored in thestorage device 108 is retrieved inblock 76. Inblock 78, it is determined whether the derived p-value exceeds the retrieved user defined p-value. As discussed in detail previously, a typical user defined p-value used may be 0.05 meaning that the difference between the control group and non-control group is statistically significant. Thus, if the derived value is less than 0.05, the decision inblock 78 is YES. Then, the routine send an alert inblock 80 without displaying the actual output value(s). The alert can be in the form of a flashing display, alarm, a change in the system output display to the user by virtue of color-coding, fonts, icons or text, or an automated system generated message to the user by way of email, facsimile, telephone or pager. - In
block 82, the routine, as an option according to a user definedoutput mode 84, can also create other outputs such as the generic data tables 66, 68 created inblock 64. The output data could take various formats including plain text, American Standard Code for Information Interchange (ASCII), and SAS. Where appropriate, this would allow for more customized statistical analysis to be performed. These outputs may also be integrated with other software packages for creation of customized graphical reports. - If the trial is a randomized clinical trial, it is preferable to execute only block 80 which provides a Boolean output as to whether or not a particular study parameter has reached the desired level of statistical significance or not.
Block 82 in that case is then skipped. The benefit of such a mode is to maintain the blinding information as securely as possible, and minimize the ability for inference to be made about the study arm of any given subject. In monitoring the exact numeric determination of statistical significance for any given clinical trial variable, it is conceivable that the accession of new data could cause statistical metrics for a particular study arm to change in such a manner that inference could be made regarding the blinding status of the subject whose data was most recently added, thus compromising statistical veil. -
Block 80 may be useful in non-randomized trials because there is a benefit to display the specific numeric value corresponding to statistical significance, and since there is no blinding information to protect, it would be offered as a second mode of operation in the system. Alternatively, a third mode could be provided, whereby numeric ranges of statistical significance could be defined into groups that would be output to the user of the system. - If, however, the p-value derived is higher than the user-defined p-value, then the derived value does not exceed the user defined threshold value. In that case, the decision is NO and the routine 50 executes
block 86. Inblock 86, the routine 50 waits for a predetermined amount of time and control passes to block 52 where the process of analyzing the trial data while the trial is ongoing is repeated. In other words, thesystem 100 is active throughout the data collection phase of the clinical trial, sending alerts when key parameters reach the pre-set level of statistical measure. - As can be appreciated by persons of ordinary skill in the art, the ability of the present
clinical trial system 100 to continuously and confidentially monitor and analyze the trial data for statistical significance in tandem with data collection while the trial is ongoing is a tremendous benefit to the researchers. The trial database no longer becomes the bottleneck in obtaining useful results and statistical analysis can be conducted on a near real-time basis. - This continuous near real-time statistical analysis feature in turn has far reaching implications. Specifically, by providing researchers with an early indication of the clinical trial, the present invention shortens the time frame required to reach critical decisions about a new medical therapy. Still another advantage is that the present system improves patient safety by setting thresholds for triggering alerts for adverse events. A related advantage is that a futile trial can be ended early, thereby saving the substantial cost of conducting the trial. Conversely, for a successful medical treatment, a trial can be ended early or the placebo arm can be eliminated. The present invention also provides the ability to more accurately identify the need to perform a full-scale interim analysis.
- Various omissions, modifications, substitutions and changes in the forms and details of the device illustrated and in its operation can be made by those skilled in the art without departing in any way from the spirit of the present invention. Accordingly, the scope of the invention is not limited to the foregoing specification, but instead is given by the appended claims along with their full range of equivalents.
Claims (24)
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/667,848 US20050075832A1 (en) | 2003-09-22 | 2003-09-22 | System and method for continuous data analysis of an ongoing clinical trial |
JP2006527136A JP5166734B2 (en) | 2003-09-22 | 2004-09-22 | System and method for continuous data analysis of ongoing clinical trials |
PCT/US2004/030922 WO2005031509A2 (en) | 2003-09-22 | 2004-09-22 | System and method for continuous data analysis of an ongoing clinical trial |
EP04784687A EP1673678A4 (en) | 2003-09-22 | 2004-09-22 | System and method for continuous data analysis of an ongoing clinical trial |
US11/810,483 US7752057B2 (en) | 2003-09-22 | 2007-06-06 | System and method for continuous data analysis of an ongoing clinical trial |
US12/817,458 US20110161101A1 (en) | 2003-09-22 | 2010-06-17 | System and method for continuous data analysis of an ongoing clinical trial |
JP2012248718A JP5414876B2 (en) | 2003-09-22 | 2012-11-12 | System and method for continuous data analysis of ongoing clinical trials |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/667,848 US20050075832A1 (en) | 2003-09-22 | 2003-09-22 | System and method for continuous data analysis of an ongoing clinical trial |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/810,483 Continuation-In-Part US7752057B2 (en) | 2003-09-22 | 2007-06-06 | System and method for continuous data analysis of an ongoing clinical trial |
Publications (1)
Publication Number | Publication Date |
---|---|
US20050075832A1 true US20050075832A1 (en) | 2005-04-07 |
Family
ID=34393396
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/667,848 Abandoned US20050075832A1 (en) | 2003-09-22 | 2003-09-22 | System and method for continuous data analysis of an ongoing clinical trial |
US11/810,483 Expired - Lifetime US7752057B2 (en) | 2003-09-22 | 2007-06-06 | System and method for continuous data analysis of an ongoing clinical trial |
US12/817,458 Abandoned US20110161101A1 (en) | 2003-09-22 | 2010-06-17 | System and method for continuous data analysis of an ongoing clinical trial |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/810,483 Expired - Lifetime US7752057B2 (en) | 2003-09-22 | 2007-06-06 | System and method for continuous data analysis of an ongoing clinical trial |
US12/817,458 Abandoned US20110161101A1 (en) | 2003-09-22 | 2010-06-17 | System and method for continuous data analysis of an ongoing clinical trial |
Country Status (4)
Country | Link |
---|---|
US (3) | US20050075832A1 (en) |
EP (1) | EP1673678A4 (en) |
JP (2) | JP5166734B2 (en) |
WO (1) | WO2005031509A2 (en) |
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050096866A1 (en) * | 2003-10-31 | 2005-05-05 | Shan Jerry Z. | Techniques for monitoring a data stream |
US20050288967A1 (en) * | 2004-06-04 | 2005-12-29 | Gary Zammit | Methods for centralized data management for electronic patient data in clinical care and multicenter clinical trials |
US20060129326A1 (en) * | 2004-12-10 | 2006-06-15 | Braconnier Paul H | System for continuous outcome prediction during a clinical trial |
WO2007035958A2 (en) | 2005-09-23 | 2007-03-29 | Acorda Therapeutics, Inc. | Method, apparatus and software for identifying responders in a clinical environment |
US20070294113A1 (en) * | 2006-06-14 | 2007-12-20 | General Electric Company | Method for evaluating correlations between structured and normalized information on genetic variations between humans and their personal clinical patient data from electronic medical patient records |
US20080037854A1 (en) * | 2006-07-13 | 2008-02-14 | Oracle International Corporation | Data Source Currency Tracking and Currency Based Execution |
US20080133213A1 (en) * | 2006-10-30 | 2008-06-05 | Noblis, Inc. | Method and system for personal information extraction and modeling with fully generalized extraction contexts |
US20080250058A1 (en) * | 2007-04-09 | 2008-10-09 | University Of Pittsburgh-Of The Commonwealth System Of Higher Education | Process data warehouse |
US20080319793A1 (en) * | 2007-06-18 | 2008-12-25 | Helmut Myritz | Method and commuication system for supporting the adherence to the study protocol of a clinical study |
US20090024414A1 (en) * | 2007-07-17 | 2009-01-22 | Eclipsys Corporation | Analytical methods and software product for automated health care information systems |
US20100017230A1 (en) * | 2008-07-18 | 2010-01-21 | Mitchel Jules T | System and method for collecting, processing, and storing discrete data records based upon a single data input |
US7657446B1 (en) * | 2008-08-22 | 2010-02-02 | Numoda Technologies, Inc. | Automated identification of tasks that must be completed before a clinical trial database can be locked |
US20100169299A1 (en) * | 2006-05-17 | 2010-07-01 | Mitretek Systems, Inc. | Method and system for information extraction and modeling |
US7921125B1 (en) | 2010-07-20 | 2011-04-05 | Numoda Technologies, Inc. | Virtual data room with access to clinical trial status reports based on real-time clinical trial data |
WO2011156717A1 (en) * | 2010-06-12 | 2011-12-15 | Medidata Solutions, Inc. | Distributed randomization and supply management in clinical trials |
US8126826B2 (en) | 2007-09-21 | 2012-02-28 | Noblis, Inc. | Method and system for active learning screening process with dynamic information modeling |
US20130185098A1 (en) * | 2008-07-18 | 2013-07-18 | Jules T. Mitchel | System and method for collecting, processing, and storing discrete data records based upon a single data input |
WO2013122469A2 (en) * | 2012-02-17 | 2013-08-22 | Rijksuniversiteit Groningen | Prediction of the efficacy of a medicament on renal or cardiovascular clinical outcomes |
US20140156547A1 (en) * | 2012-11-30 | 2014-06-05 | The Children's Hospital Of Philadelphia | Methods and systems for assessing computer applications |
US20150127375A1 (en) * | 2013-11-01 | 2015-05-07 | Ta-Hsiung Hu | Methods and systems for cloud-based medical database management |
AU2013206188B2 (en) * | 2005-09-23 | 2016-04-14 | Acorda Therapeutics, Inc. | Method, apparatus and software for identifying responders in a clinical environment |
WO2017046081A1 (en) * | 2015-09-15 | 2017-03-23 | N.V. Nutricia | Network connectivity analysis |
US20180068323A1 (en) * | 2016-09-03 | 2018-03-08 | Neustar, Inc. | Automated method for learning the responsiveness of potential consumers to different stimuli in a marketplace |
WO2020026208A1 (en) * | 2018-08-02 | 2020-02-06 | Bright Clinical Research Limited | Systems, methods and processes for dynamic data monitoring and real-time optimization of ongoing clinical research trials |
CN111602208A (en) * | 2018-01-16 | 2020-08-28 | 永续医疗株式会社 | System for verifying therapeutic application, terminal device equipped with therapeutic application, and therapeutic application program |
CN112652368A (en) * | 2020-12-31 | 2021-04-13 | 中山大学肿瘤防治中心(中山大学附属肿瘤医院、中山大学肿瘤研究所) | Data analysis method and device |
AU2021226201B2 (en) * | 2020-02-26 | 2023-09-07 | Bright Clinical Research Limited | A radar system for dynamically monitoring and guiding ongoing clinical trials |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6907571B2 (en) * | 2000-03-01 | 2005-06-14 | Benjamin Slotznick | Adjunct use of instant messenger software to enable communications to or between chatterbots or other software agents |
US7856362B2 (en) | 2005-04-25 | 2010-12-21 | Ingenix, Inc. | System and method for early identification of safety concerns of new drugs |
US7917374B2 (en) | 2005-04-25 | 2011-03-29 | Ingenix, Inc. | System and method for early identification of safety concerns of new drugs |
US20070067189A1 (en) * | 2005-09-16 | 2007-03-22 | Numoda Corporation | Method and apparatus for screening, enrollment and management of patients in clinical trials |
US8409124B2 (en) * | 2007-03-08 | 2013-04-02 | Medronic, Inc. | Blood pump system user interface alarm management |
US20090192362A1 (en) * | 2008-01-24 | 2009-07-30 | Sweeney Robert J | System And Method For Corroborating Transitory Changes In Wellness Status Against A Patient Population |
US7765489B1 (en) | 2008-03-03 | 2010-07-27 | Shah Shalin N | Presenting notifications related to a medical study on a toolbar |
US8429547B2 (en) * | 2009-10-20 | 2013-04-23 | Universal Research Solutions, Llc | Generation and data management of a medical study using instruments in an integrated media and medical system |
US20110238438A1 (en) * | 2010-03-25 | 2011-09-29 | Numoda Technologies, Inc. | Automated method of graphically displaying predicted patient enrollment in a clinical trial study |
US9892236B2 (en) * | 2011-03-22 | 2018-02-13 | Numoda Technologies, Inc. | Automated method of generating reconciliation reports regarding mismatches of clinical data received from multiple sources during a clinical trial |
US9177102B2 (en) | 2011-04-28 | 2015-11-03 | Bioptigen, Inc. | Database and imaging processing system and methods for analyzing images acquired using an image acquisition system |
US9495702B2 (en) * | 2011-09-20 | 2016-11-15 | Oracle International Corporation | Dynamic auction monitor with graphic interpretive data change indicators |
US10762983B2 (en) | 2012-08-08 | 2020-09-01 | Cerner Innovation, Inc. | Selecting alternate results for integrated data capture |
US8706537B1 (en) * | 2012-11-16 | 2014-04-22 | Medidata Solutions, Inc. | Remote clinical study site monitoring and data quality scoring |
US20150269355A1 (en) * | 2014-03-19 | 2015-09-24 | Peach Intellihealth, Inc. | Managing allocation of health-related expertise and resources |
US20160180275A1 (en) * | 2014-12-18 | 2016-06-23 | Medidata Solutions, Inc. | Method and system for determining a site performance index |
US20170193195A1 (en) * | 2015-12-30 | 2017-07-06 | Cerner Innovation, Inc. | Clinical study trend analyzer |
WO2019195482A1 (en) | 2018-04-03 | 2019-10-10 | Otsuka America Pharmaceutical Inc. | Database lock |
US11139051B2 (en) | 2018-10-02 | 2021-10-05 | Origent Data Sciences, Inc. | Systems and methods for designing clinical trials |
JP7180496B2 (en) * | 2019-03-27 | 2022-11-30 | 富士通株式会社 | Patient search support program, patient search support system, and patient search support method |
US20210280304A1 (en) * | 2020-03-08 | 2021-09-09 | Gen LI | Integrated clinical trial design and design optimization |
JP2023548049A (en) * | 2020-10-22 | 2023-11-15 | トニックス ファーマシューティカルズ ホールディング コーポレイション | Randomization implementing methods to assess the significance of interventions on disability outcomes |
Citations (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5687722A (en) * | 1995-05-17 | 1997-11-18 | Spacelabs Medical, Inc. | System and method for the algebraic derivation of physiological signals |
US5757664A (en) * | 1996-06-04 | 1998-05-26 | Warren Rogers Associates, Inc. | Method and apparatus for monitoring operational performance of fluid storage systems |
US5924073A (en) * | 1995-11-14 | 1999-07-13 | Beacon Patient Physician Association, Llc | System and method for assessing physician performance using robust multivariate techniques of statistical analysis |
US5978751A (en) * | 1997-02-25 | 1999-11-02 | International Business Machines Corporation | Variegated manufacturing process test method and apparatus |
US6368284B1 (en) * | 1999-11-16 | 2002-04-09 | Cardiac Intelligence Corporation | Automated collection and analysis patient care system and method for diagnosing and monitoring myocardial ischemia and outcomes thereof |
US6398728B1 (en) * | 1999-11-16 | 2002-06-04 | Cardiac Intelligence Corporation | Automated collection and analysis patient care system and method for diagnosing and monitoring respiratory insufficiency and outcomes thereof |
US6411840B1 (en) * | 1999-11-16 | 2002-06-25 | Cardiac Intelligence Corporation | Automated collection and analysis patient care system and method for diagnosing and monitoring the outcomes of atrial fibrillation |
US6418334B1 (en) * | 1999-10-19 | 2002-07-09 | General Electric Company | Method and apparatus for logging and dynamically configuring performance analysis of a medical diagnostic imaging system |
US20020099302A1 (en) * | 1999-11-16 | 2002-07-25 | Bardy Gust H. | System and method for providing diagnosis and montoring of congestive heart faliure for use in automated patient care |
US20020143577A1 (en) * | 2001-04-02 | 2002-10-03 | Saul Shiffman | Apparatus and method for prediction and management of subject compliance in clinical research |
US20020183965A1 (en) * | 2001-05-02 | 2002-12-05 | Gogolak Victor V. | Method for analyzing drug adverse effects employing multivariate statistical analysis |
US20030065535A1 (en) * | 2001-05-01 | 2003-04-03 | Structural Bioinformatics, Inc. | Diagnosing inapparent diseases from common clinical tests using bayesian analysis |
US6572556B2 (en) * | 2000-12-29 | 2003-06-03 | Ge Medical Systems Information Technologies | Distributed multi-user catalog-based system for real time data access during cardiology procedures |
US20030104453A1 (en) * | 2001-11-06 | 2003-06-05 | David Pickar | System for pharmacogenetics of adverse drug events |
US6575901B2 (en) * | 2000-12-29 | 2003-06-10 | Ge Medical Systems Information Technologies | Distributed real time replication-based annotation and documentation system for cardiology procedures |
US20040078228A1 (en) * | 2002-05-31 | 2004-04-22 | Fitzgerald David | System for monitoring healthcare patient encounter related information |
US20040133450A1 (en) * | 2001-02-19 | 2004-07-08 | Ola Foureaux | Control system and method intended to be used when performing clinical trials |
US20040148195A1 (en) * | 2002-10-08 | 2004-07-29 | Kalies Ralph F. | Method for storing and reporting pharmacy data |
US6795793B2 (en) * | 2002-07-19 | 2004-09-21 | Med-Ed Innovations, Inc. | Method and apparatus for evaluating data and implementing training based on the evaluation of the data |
US6820235B1 (en) * | 1998-06-05 | 2004-11-16 | Phase Forward Inc. | Clinical trial data management system and method |
US20040243440A1 (en) * | 2002-12-20 | 2004-12-02 | Colin Corporation | Statistical medical information providing apparatus |
US20040243439A1 (en) * | 2003-05-30 | 2004-12-02 | Solutia Inc. | Methods and systems for clinical trial data gathering and management |
US20040243555A1 (en) * | 2003-05-30 | 2004-12-02 | Oracle International Corp. | Methods and systems for optimizing queries through dynamic and autonomous database schema analysis |
US6829623B2 (en) * | 2000-09-08 | 2004-12-07 | Hitachi, Ltd. | Method and system for managing multiple database storage units |
US6832110B2 (en) * | 2001-09-05 | 2004-12-14 | Haim Sohmer | Method for analysis of ongoing and evoked neuro-electrical activity |
US6834256B2 (en) * | 2002-08-30 | 2004-12-21 | General Electric Company | Method and system for determining motor reliability |
US20050010451A1 (en) * | 2003-05-08 | 2005-01-13 | University Of Florida | Method, system, and apparatus for clinical trial management over a communications network |
US20050038692A1 (en) * | 2003-08-14 | 2005-02-17 | Kane John Michael | System and method for facilitating centralized candidate selection and monitoring subject participation in clinical trial studies |
US6904434B1 (en) * | 2001-12-18 | 2005-06-07 | Siebel Systems, Inc. | Method and system for providing real-time clinical trial enrollment data |
US20050149869A1 (en) * | 2003-07-11 | 2005-07-07 | Informedix, Inc. | Clinical trial monitoring system and method |
US6922654B2 (en) * | 2000-10-09 | 2005-07-26 | Rados Technology Gmbh | Method for shortening the statistical measurement times in the domain of radioactivity measurements |
US20050182664A1 (en) * | 2004-02-18 | 2005-08-18 | Klaus Abraham-Fuchs | Method of monitoring patient participation in a clinical study |
US20050182658A1 (en) * | 2004-02-18 | 2005-08-18 | Klaus Abraham-Fuchs | Method of improving a clinical study |
US20050182657A1 (en) * | 2004-02-18 | 2005-08-18 | Klaus Abraham-Fuchs | Method and system for measuring quality of performance and/or compliance with protocol of a clinical study |
US20050187795A1 (en) * | 2004-02-24 | 2005-08-25 | Mary Russell | Dynamic safety monitoring in clinical trial |
US20050228808A1 (en) * | 2003-08-27 | 2005-10-13 | Ascential Software Corporation | Real time data integration services for health care information data integration |
US20050234740A1 (en) * | 2003-06-25 | 2005-10-20 | Sriram Krishnan | Business methods and systems for providing healthcare management and decision support services using structured clinical information extracted from healthcare provider data |
US20050267782A1 (en) * | 2004-05-28 | 2005-12-01 | Gudrun Zahlmann | System for processing patient medical data for clinical trials and aggregate analysis |
US7054823B1 (en) * | 1999-09-10 | 2006-05-30 | Schering Corporation | Clinical trial management system |
US20060129326A1 (en) * | 2004-12-10 | 2006-06-15 | Braconnier Paul H | System for continuous outcome prediction during a clinical trial |
US7089247B2 (en) * | 2001-06-08 | 2006-08-08 | Roche Palo Alto Llc | System and method for resolving a discrepancy in a clinical data management system |
US20060178906A1 (en) * | 2005-01-13 | 2006-08-10 | Kalle Christof V | Clinical development plan, facility development plan and process development plan knowledge bases |
US20060184493A1 (en) * | 2001-04-02 | 2006-08-17 | Invivodata, Inc. | Apparatus and method for prediction and management of participant compliance in clinical research |
US20060224326A1 (en) * | 2005-03-31 | 2006-10-05 | St Ores John W | Integrated data collection and analysis for clinical study |
US20060229916A1 (en) * | 2000-01-28 | 2006-10-12 | Michelson Leslie D | Systems and methods for selecting and recruiting investigators and subjects for clinical studies |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU6047498A (en) * | 1997-03-03 | 1998-09-22 | University Of Florida | Method and system for interactive prescription and distribution of drugs in conducting medical studies |
US20030088365A1 (en) * | 2002-08-01 | 2003-05-08 | Robert Becker | System and method of drug development for selective drug use with individual, treatment responsive patients, and applications of the method in medical care |
US20040267570A1 (en) * | 2003-04-23 | 2004-12-30 | Becker Robert E. | Method for information and management system for health care |
-
2003
- 2003-09-22 US US10/667,848 patent/US20050075832A1/en not_active Abandoned
-
2004
- 2004-09-22 JP JP2006527136A patent/JP5166734B2/en active Active
- 2004-09-22 WO PCT/US2004/030922 patent/WO2005031509A2/en active Application Filing
- 2004-09-22 EP EP04784687A patent/EP1673678A4/en not_active Ceased
-
2007
- 2007-06-06 US US11/810,483 patent/US7752057B2/en not_active Expired - Lifetime
-
2010
- 2010-06-17 US US12/817,458 patent/US20110161101A1/en not_active Abandoned
-
2012
- 2012-11-12 JP JP2012248718A patent/JP5414876B2/en active Active
Patent Citations (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5687722A (en) * | 1995-05-17 | 1997-11-18 | Spacelabs Medical, Inc. | System and method for the algebraic derivation of physiological signals |
US5924073A (en) * | 1995-11-14 | 1999-07-13 | Beacon Patient Physician Association, Llc | System and method for assessing physician performance using robust multivariate techniques of statistical analysis |
US5757664A (en) * | 1996-06-04 | 1998-05-26 | Warren Rogers Associates, Inc. | Method and apparatus for monitoring operational performance of fluid storage systems |
US5978751A (en) * | 1997-02-25 | 1999-11-02 | International Business Machines Corporation | Variegated manufacturing process test method and apparatus |
US6820235B1 (en) * | 1998-06-05 | 2004-11-16 | Phase Forward Inc. | Clinical trial data management system and method |
US20050149852A1 (en) * | 1998-06-05 | 2005-07-07 | Phase Forward Inc. | Clinical trial data management system and method |
US20060143047A1 (en) * | 1999-09-10 | 2006-06-29 | Schering Corporation | Clinical trial management system |
US7054823B1 (en) * | 1999-09-10 | 2006-05-30 | Schering Corporation | Clinical trial management system |
US6418334B1 (en) * | 1999-10-19 | 2002-07-09 | General Electric Company | Method and apparatus for logging and dynamically configuring performance analysis of a medical diagnostic imaging system |
US6368284B1 (en) * | 1999-11-16 | 2002-04-09 | Cardiac Intelligence Corporation | Automated collection and analysis patient care system and method for diagnosing and monitoring myocardial ischemia and outcomes thereof |
US20020099302A1 (en) * | 1999-11-16 | 2002-07-25 | Bardy Gust H. | System and method for providing diagnosis and montoring of congestive heart faliure for use in automated patient care |
US6411840B1 (en) * | 1999-11-16 | 2002-06-25 | Cardiac Intelligence Corporation | Automated collection and analysis patient care system and method for diagnosing and monitoring the outcomes of atrial fibrillation |
US6398728B1 (en) * | 1999-11-16 | 2002-06-04 | Cardiac Intelligence Corporation | Automated collection and analysis patient care system and method for diagnosing and monitoring respiratory insufficiency and outcomes thereof |
US6908437B2 (en) * | 1999-11-16 | 2005-06-21 | Cardiac Intelligence Corporation | System and method for diagnosing and monitoring congestive heart failure for automated remote patient care |
US20060229916A1 (en) * | 2000-01-28 | 2006-10-12 | Michelson Leslie D | Systems and methods for selecting and recruiting investigators and subjects for clinical studies |
US6829623B2 (en) * | 2000-09-08 | 2004-12-07 | Hitachi, Ltd. | Method and system for managing multiple database storage units |
US6922654B2 (en) * | 2000-10-09 | 2005-07-26 | Rados Technology Gmbh | Method for shortening the statistical measurement times in the domain of radioactivity measurements |
US6572556B2 (en) * | 2000-12-29 | 2003-06-03 | Ge Medical Systems Information Technologies | Distributed multi-user catalog-based system for real time data access during cardiology procedures |
US6575901B2 (en) * | 2000-12-29 | 2003-06-10 | Ge Medical Systems Information Technologies | Distributed real time replication-based annotation and documentation system for cardiology procedures |
US20040133450A1 (en) * | 2001-02-19 | 2004-07-08 | Ola Foureaux | Control system and method intended to be used when performing clinical trials |
US20020143577A1 (en) * | 2001-04-02 | 2002-10-03 | Saul Shiffman | Apparatus and method for prediction and management of subject compliance in clinical research |
US20060184493A1 (en) * | 2001-04-02 | 2006-08-17 | Invivodata, Inc. | Apparatus and method for prediction and management of participant compliance in clinical research |
US20030065535A1 (en) * | 2001-05-01 | 2003-04-03 | Structural Bioinformatics, Inc. | Diagnosing inapparent diseases from common clinical tests using bayesian analysis |
US20020183965A1 (en) * | 2001-05-02 | 2002-12-05 | Gogolak Victor V. | Method for analyzing drug adverse effects employing multivariate statistical analysis |
US7089247B2 (en) * | 2001-06-08 | 2006-08-08 | Roche Palo Alto Llc | System and method for resolving a discrepancy in a clinical data management system |
US6832110B2 (en) * | 2001-09-05 | 2004-12-14 | Haim Sohmer | Method for analysis of ongoing and evoked neuro-electrical activity |
US20030108938A1 (en) * | 2001-11-06 | 2003-06-12 | David Pickar | Pharmacogenomics-based clinical trial design recommendation and management system and method |
US20030104453A1 (en) * | 2001-11-06 | 2003-06-05 | David Pickar | System for pharmacogenetics of adverse drug events |
US6904434B1 (en) * | 2001-12-18 | 2005-06-07 | Siebel Systems, Inc. | Method and system for providing real-time clinical trial enrollment data |
US20040078228A1 (en) * | 2002-05-31 | 2004-04-22 | Fitzgerald David | System for monitoring healthcare patient encounter related information |
US6795793B2 (en) * | 2002-07-19 | 2004-09-21 | Med-Ed Innovations, Inc. | Method and apparatus for evaluating data and implementing training based on the evaluation of the data |
US6834256B2 (en) * | 2002-08-30 | 2004-12-21 | General Electric Company | Method and system for determining motor reliability |
US20040148195A1 (en) * | 2002-10-08 | 2004-07-29 | Kalies Ralph F. | Method for storing and reporting pharmacy data |
US20040243440A1 (en) * | 2002-12-20 | 2004-12-02 | Colin Corporation | Statistical medical information providing apparatus |
US20050010451A1 (en) * | 2003-05-08 | 2005-01-13 | University Of Florida | Method, system, and apparatus for clinical trial management over a communications network |
US20040243439A1 (en) * | 2003-05-30 | 2004-12-02 | Solutia Inc. | Methods and systems for clinical trial data gathering and management |
US20040243555A1 (en) * | 2003-05-30 | 2004-12-02 | Oracle International Corp. | Methods and systems for optimizing queries through dynamic and autonomous database schema analysis |
US20050234740A1 (en) * | 2003-06-25 | 2005-10-20 | Sriram Krishnan | Business methods and systems for providing healthcare management and decision support services using structured clinical information extracted from healthcare provider data |
US20050149869A1 (en) * | 2003-07-11 | 2005-07-07 | Informedix, Inc. | Clinical trial monitoring system and method |
US20050038692A1 (en) * | 2003-08-14 | 2005-02-17 | Kane John Michael | System and method for facilitating centralized candidate selection and monitoring subject participation in clinical trial studies |
US20050228808A1 (en) * | 2003-08-27 | 2005-10-13 | Ascential Software Corporation | Real time data integration services for health care information data integration |
US20050182657A1 (en) * | 2004-02-18 | 2005-08-18 | Klaus Abraham-Fuchs | Method and system for measuring quality of performance and/or compliance with protocol of a clinical study |
US20050182658A1 (en) * | 2004-02-18 | 2005-08-18 | Klaus Abraham-Fuchs | Method of improving a clinical study |
US20050182664A1 (en) * | 2004-02-18 | 2005-08-18 | Klaus Abraham-Fuchs | Method of monitoring patient participation in a clinical study |
US20050187795A1 (en) * | 2004-02-24 | 2005-08-25 | Mary Russell | Dynamic safety monitoring in clinical trial |
US20050267782A1 (en) * | 2004-05-28 | 2005-12-01 | Gudrun Zahlmann | System for processing patient medical data for clinical trials and aggregate analysis |
US20060129326A1 (en) * | 2004-12-10 | 2006-06-15 | Braconnier Paul H | System for continuous outcome prediction during a clinical trial |
US20060178906A1 (en) * | 2005-01-13 | 2006-08-10 | Kalle Christof V | Clinical development plan, facility development plan and process development plan knowledge bases |
US20060224326A1 (en) * | 2005-03-31 | 2006-10-05 | St Ores John W | Integrated data collection and analysis for clinical study |
Cited By (54)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8185348B2 (en) * | 2003-10-31 | 2012-05-22 | Hewlett-Packard Development Company, L.P. | Techniques for monitoring a data stream |
US20050096866A1 (en) * | 2003-10-31 | 2005-05-05 | Shan Jerry Z. | Techniques for monitoring a data stream |
US20050288967A1 (en) * | 2004-06-04 | 2005-12-29 | Gary Zammit | Methods for centralized data management for electronic patient data in clinical care and multicenter clinical trials |
EP1872289A4 (en) * | 2004-12-10 | 2010-07-21 | Azera Res Inc | System for continuous outcome prediction during a clinical trial |
WO2006085146A3 (en) * | 2004-12-10 | 2007-11-29 | Azera Res Inc | System for continuous outcome prediction during a clinical trial |
EP1872289A2 (en) * | 2004-12-10 | 2008-01-02 | Azera Research, Inc. | System for continuous outcome prediction during a clinical trial |
US20060129326A1 (en) * | 2004-12-10 | 2006-06-15 | Braconnier Paul H | System for continuous outcome prediction during a clinical trial |
EP1940285A2 (en) * | 2005-09-23 | 2008-07-09 | Acorda Therapeutics, Inc. | Method, apparatus and software for identifying responders in a clinical environment |
EP1940285A4 (en) * | 2005-09-23 | 2010-11-24 | Acorda Therapeutics Inc | Method, apparatus and software for identifying responders in a clinical environment |
WO2007035958A2 (en) | 2005-09-23 | 2007-03-29 | Acorda Therapeutics, Inc. | Method, apparatus and software for identifying responders in a clinical environment |
AU2013206188B2 (en) * | 2005-09-23 | 2016-04-14 | Acorda Therapeutics, Inc. | Method, apparatus and software for identifying responders in a clinical environment |
US7890533B2 (en) | 2006-05-17 | 2011-02-15 | Noblis, Inc. | Method and system for information extraction and modeling |
US20100169299A1 (en) * | 2006-05-17 | 2010-07-01 | Mitretek Systems, Inc. | Method and system for information extraction and modeling |
US20070294113A1 (en) * | 2006-06-14 | 2007-12-20 | General Electric Company | Method for evaluating correlations between structured and normalized information on genetic variations between humans and their personal clinical patient data from electronic medical patient records |
US20080037854A1 (en) * | 2006-07-13 | 2008-02-14 | Oracle International Corporation | Data Source Currency Tracking and Currency Based Execution |
US8078579B2 (en) * | 2006-07-13 | 2011-12-13 | Oracle International Corporation | Data source currency tracking and currency based execution |
US9177051B2 (en) | 2006-10-30 | 2015-11-03 | Noblis, Inc. | Method and system for personal information extraction and modeling with fully generalized extraction contexts |
US7949629B2 (en) | 2006-10-30 | 2011-05-24 | Noblis, Inc. | Method and system for personal information extraction and modeling with fully generalized extraction contexts |
US20080133213A1 (en) * | 2006-10-30 | 2008-06-05 | Noblis, Inc. | Method and system for personal information extraction and modeling with fully generalized extraction contexts |
WO2008124784A1 (en) * | 2007-04-09 | 2008-10-16 | University Of Pittsburgh - Of The Commonwealth System Of Higher Education | Process data warehouse |
US20080250058A1 (en) * | 2007-04-09 | 2008-10-09 | University Of Pittsburgh-Of The Commonwealth System Of Higher Education | Process data warehouse |
US7933861B2 (en) | 2007-04-09 | 2011-04-26 | University Of Pittsburgh - Of The Commonwealth System Of Higher Education | Process data warehouse |
US20080319793A1 (en) * | 2007-06-18 | 2008-12-25 | Helmut Myritz | Method and commuication system for supporting the adherence to the study protocol of a clinical study |
US20090024414A1 (en) * | 2007-07-17 | 2009-01-22 | Eclipsys Corporation | Analytical methods and software product for automated health care information systems |
US8126826B2 (en) | 2007-09-21 | 2012-02-28 | Noblis, Inc. | Method and system for active learning screening process with dynamic information modeling |
US10475531B2 (en) * | 2008-07-18 | 2019-11-12 | Jules T. Mitchel | Method for collecting, processing, and storing discrete data records based upon a single data input |
US8041581B2 (en) * | 2008-07-18 | 2011-10-18 | Mitchel Jules T | System and method for collecting, processing, and storing discrete data records based upon a single data input |
US20100017230A1 (en) * | 2008-07-18 | 2010-01-21 | Mitchel Jules T | System and method for collecting, processing, and storing discrete data records based upon a single data input |
US9830574B2 (en) * | 2008-07-18 | 2017-11-28 | Jules T. Mitchel | System and method for collecting, processing, and storing discrete data records based upon a single data input |
US11301808B2 (en) | 2008-07-18 | 2022-04-12 | Jules T. Mitchel | System and method for collecting, processing, and storing discrete data records based upon a single data input |
US20120022889A1 (en) * | 2008-07-18 | 2012-01-26 | Mitchel Jules T | Method for collecting, processing, and storing discrete data records based upon a single data input |
US20130185098A1 (en) * | 2008-07-18 | 2013-07-18 | Jules T. Mitchel | System and method for collecting, processing, and storing discrete data records based upon a single data input |
US9672580B2 (en) | 2008-08-22 | 2017-06-06 | Numoda Technologies, Inc. | Automated identification of task items that must be completed before a clinical trial database can be locked |
US20100049545A1 (en) * | 2008-08-22 | 2010-02-25 | Numoda Technologies, Inc. | Automated identification of tasks that must be completed before a clinical trial database can be locked |
US7657446B1 (en) * | 2008-08-22 | 2010-02-02 | Numoda Technologies, Inc. | Automated identification of tasks that must be completed before a clinical trial database can be locked |
WO2011156717A1 (en) * | 2010-06-12 | 2011-12-15 | Medidata Solutions, Inc. | Distributed randomization and supply management in clinical trials |
US8738397B2 (en) | 2010-06-12 | 2014-05-27 | Medidata Solutions, Inc. | Distributed randomization and supply management in clinical trials |
US8266161B2 (en) | 2010-07-20 | 2012-09-11 | Numoda Technologies, Inc. | Virtual data room for displaying clinical trial status reports based on real-time clinical trial data, with information control administration module that specifies which reports are available for display |
US7921125B1 (en) | 2010-07-20 | 2011-04-05 | Numoda Technologies, Inc. | Virtual data room with access to clinical trial status reports based on real-time clinical trial data |
WO2013122469A3 (en) * | 2012-02-17 | 2013-10-10 | Rijksuniversiteit Groningen | Prediction of the efficacy of a medicament on renal or cardiovascular clinical outcomes |
WO2013122469A2 (en) * | 2012-02-17 | 2013-08-22 | Rijksuniversiteit Groningen | Prediction of the efficacy of a medicament on renal or cardiovascular clinical outcomes |
US20140156547A1 (en) * | 2012-11-30 | 2014-06-05 | The Children's Hospital Of Philadelphia | Methods and systems for assessing computer applications |
US20150127375A1 (en) * | 2013-11-01 | 2015-05-07 | Ta-Hsiung Hu | Methods and systems for cloud-based medical database management |
TWI649762B (en) * | 2013-11-01 | 2019-02-01 | Ta Hsiung Hu | Methods and systems for cloud-based medical database management |
CN104615633A (en) * | 2013-11-01 | 2015-05-13 | 胡大雄 | Methods and systems for cloud-based medical database management |
WO2017046081A1 (en) * | 2015-09-15 | 2017-03-23 | N.V. Nutricia | Network connectivity analysis |
US20180068323A1 (en) * | 2016-09-03 | 2018-03-08 | Neustar, Inc. | Automated method for learning the responsiveness of potential consumers to different stimuli in a marketplace |
CN111602208A (en) * | 2018-01-16 | 2020-08-28 | 永续医疗株式会社 | System for verifying therapeutic application, terminal device equipped with therapeutic application, and therapeutic application program |
EP3723015A4 (en) * | 2018-01-16 | 2020-10-14 | Sustainable Medicine, Inc. | Clinical trial system for treatment application, terminal device having treatment application mounted thereon, and treatment application program |
WO2020026208A1 (en) * | 2018-08-02 | 2020-02-06 | Bright Clinical Research Limited | Systems, methods and processes for dynamic data monitoring and real-time optimization of ongoing clinical research trials |
EP3830685A4 (en) * | 2018-08-02 | 2022-04-27 | Bright Clinical Research Limited | Systems, methods and processes for dynamic data monitoring and real-time optimization of ongoing clinical research trials |
TWI819049B (en) * | 2018-08-02 | 2023-10-21 | 香港商布萊特臨床研究有限公司 | Systems, methods and processes for dynamic data monitoring and real-time optimization of ongoing clinical research trials |
AU2021226201B2 (en) * | 2020-02-26 | 2023-09-07 | Bright Clinical Research Limited | A radar system for dynamically monitoring and guiding ongoing clinical trials |
CN112652368A (en) * | 2020-12-31 | 2021-04-13 | 中山大学肿瘤防治中心(中山大学附属肿瘤医院、中山大学肿瘤研究所) | Data analysis method and device |
Also Published As
Publication number | Publication date |
---|---|
JP2007506198A (en) | 2007-03-15 |
WO2005031509A2 (en) | 2005-04-07 |
US20110161101A1 (en) | 2011-06-30 |
US20080046469A1 (en) | 2008-02-21 |
JP5166734B2 (en) | 2013-03-21 |
WO2005031509A3 (en) | 2006-05-26 |
EP1673678A4 (en) | 2008-11-19 |
JP5414876B2 (en) | 2014-02-12 |
US7752057B2 (en) | 2010-07-06 |
EP1673678A2 (en) | 2006-06-28 |
JP2013061970A (en) | 2013-04-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20050075832A1 (en) | System and method for continuous data analysis of an ongoing clinical trial | |
US20220208314A1 (en) | Synthesizing complex population selection criteria | |
US7734477B2 (en) | System and method for monitoring patient care | |
US20040078228A1 (en) | System for monitoring healthcare patient encounter related information | |
US20130006657A1 (en) | Reporting and analytics for healthcare fraud detection information | |
US20050049910A1 (en) | System and method for management interface for clinical environments | |
US10509890B2 (en) | Predictive modeling processes for healthcare fraud detection | |
US20080208813A1 (en) | System and method for quality control in healthcare settings to continuously monitor outcomes and undesirable outcomes such as infections, re-operations, excess mortality, and readmissions | |
Shaqdan et al. | Root-cause analysis and health failure mode and effect analysis: two leading techniques in health care quality assessment | |
US20050060193A1 (en) | System and method for evidence-based modeling of clinical operations | |
US11437126B2 (en) | Methods and systems for analyzing accessing of medical data | |
US20230178189A1 (en) | System and method for phenotype vector manipulation of medical data | |
Liu | Real-world data for the drug development in the digital era | |
Antoniades et al. | Linked2Safety: A secure linked data medical information space for semantically-interconnecting EHRs advancing patients' safety in medical research | |
CN115579117A (en) | Data assets system and method of medical data | |
Kim et al. | Anomaly and signature filtering improve classifier performance for detection of suspicious access to EHRs | |
Devine et al. | Automating electronic clinical data capture for quality improvement and research: the CERTAIN validation project of real world evidence | |
CN113642672A (en) | Feature processing method and device of medical insurance data, computer equipment and storage medium | |
Ahmed et al. | A proposed framework for detecting and predicting diseases through business intelligence applications | |
WO2012074723A1 (en) | Privacy awareness tool | |
Oluwagbemi et al. | A knowledge-based data mining system for diagnosing malaria related cases in healthcare management | |
KR20180108671A (en) | Method and system for identifying diagnostic and treatment options for medical conditions using electronic health records | |
US11720567B2 (en) | Method and system for processing large amounts of real world evidence | |
Seng et al. | Collaborative support for medical data mining in telemedicine | |
JP2005242472A (en) | Examination management method and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MEDIDATA SOLUTIONS, INC., NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IKEGUCHI, EDWARD F.;DEVRIES, GLEN M.;SHERIF, TAREK A.;REEL/FRAME:014985/0438 Effective date: 20030922 |
|
AS | Assignment |
Owner name: STONEHENGE CAPITAL FUND NEW YORK, LLC, NEW YORK Free format text: SECURITY AGREEMENT;ASSIGNOR:MEDIDATA SOLUTIONS, INC.;REEL/FRAME:019935/0613 Effective date: 20071002 |
|
AS | Assignment |
Owner name: MEDIDATA SOLUTIONS, INC., NEW YORK Free format text: RELEASE OF SECURITY INTEREST IN PATENTS WITH APPENDIX;ASSIGNOR:STONEHENGE CAPITAL FUND NEW YORK, LLC;REEL/FRAME:021556/0368 Effective date: 20080916 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |