The field of Applied Behavior Analysis (ABA) relies heavily on data to make informed treatment decisions. Professionals in the field must choose the data collection method that measures the right behavior. They analyze data to determine the effectiveness of interventions. If the data demonstrate progress, interventions continue. If the data reveal a trend in the wrong direction, the professional changes the intervention.
The right data collection system provides information needed to determine the effectiveness of programming. Choose either a continuous data collection method (frequency, rate, duration, or latency) or a discontinuous data collection method (partial interval, whole interval, or momentary time sampling). The right method provides accurate data that are sensitive to behavior change. Continuous methods provide the most accurate data, although they can be difficult to utilize in busy environments. Discontinuous methods offer an estimate of the occurrence of behavior, but can be used even when staff can’t attend to the learner’s behavior throughout the entire session.
Whether you’re an RBT or BCBA candidate studying for the exam or a new professional just starting out, these data collection methods can be confusing.
Download this infographic to help you keep this information fresh!
ContentsContinuous Data Collection Discontinuous Data Collection Other Data Collection Methods Advantages and Disadvantages of Each Type of Data Collection Method 5 Ways to Make Frequency Data Collection Easier and More Discrete Research in Data Collection Methods Ethical Considerations When Choosing Data Collection Methods Research Related to Choosing Data Collection Methods References and Related Reading
Continuous Data Collection
Continuous data collection methods measure every occurrence of a behavior. These methods either count each instance of the behavior or the specific amount of time a behavior occurs. These methods allow you to measure behavior along the basic dimensions and accurately detect change in the behavior. Choose a continuous method when programming requires a complete record of behavior. Several different systems provide continuous data.
The video below provides a brief overview of 4 types of continuous data collection methods.
Frequency provides a simple count of the behavior that occurs. Record the frequency of the behavior using tally marks, a clicker, or even small objects. Moving small beads from one pocket to another when a behavior occurs provides a simple way of discretely counting the occurrence of the behavior. Once the session ends, count the number of beads and enter that number onto your data sheet. Use frequency measurement when the behaviors:
- Have a clear beginning and end
- Occur at a rate that can accurately be counted
Frequency measures both desirable and undesirable behavior such as the number of times your client pees on the potty or throws toys. Simple frequency counts are easy for staff to collect; however, they don’t take into consideration how long each session is and can be misleading when session duration varies widely. For example, 10 instances of behavior occurring in a 30-minute session is quite different than 10 instances occurring during a 4-hour session.
Record frequency data using tally marks or use a clicker to count then record the total on a simple frequency data sheet. Download the simple frequency data sheet below to get started.
Rate measurements level the playing field regarding session duration. They reflect the frequency of behavior that occurs over a period of time. This type of data provides you with more information than frequency data alone and typically is a more accurate representation of the behavior. To calculate rate, divide the frequency by the duration of the session (i.e. minutes or hours). Rate is expressed as a number per unit of time (i.e. 6 instances per hour or 12 instances per minute).
Use rate data when:
- Session duration is inconsistent
- You measure the behavior during some parts of the day but not others
As with other continuous data collection measures, rate data can be used to document behaviors targeted for increase or decrease. You may choose to use rate data to determine the number of times per hour your client mands for something he wants or engages in aggressive behaviors.
Record rate data in much the same way that you record frequency data, but specify the period of time the behavior occurred during (i.e. per minute, per hour, per day, etc.). Download the simple rate data sheet below to get started.
Duration data measure how long a behavior lasts from beginning to end. When defining behaviors to be collected by duration recording, professionals must identify an onset and offset to ensure accurate measurement. A stopwatch or timer in a data collection app provides the most reliable duration data. Avoid estimating duration by expecting staff to look at a clock or watch to measure the time. Use duration recording when the behaviors:
- Have ambiguous beginning and end
- Last for an inconsistent period of time
Again, duration could measure both behaviors you want to increase as well as those you are looking to decrease. Amount of time spent engaging in imaginative play or in a tantrum are examples of behaviors you might measure using duration data.
Record duration data by noting the amount of time a behavior occurred during each occurrence. You can also calculate the frequency of the behavior by counting the number of times you recorded the duration. Download the simple duration data sheet below to get started.
Latency measures the time between the discriminative stimuli (SD) and the response. This measure allows you to evaluate the speed of responding to a particular stimulus. For example, you may use latency data to increase the rate of responding during DTT (by decreasing latency) or you may use it to decrease the rate of responding prior to hearing the full SD during DTT (by increasing latency). Use latency data when:
- Responses occur too slowly or too quickly following the SD
Latency measures provide highly specific information. To record latency, initiate the time on a stopwatch following the delivery of the SD and stop the time as soon as the learner begins to respond.
Record latency data by recording the SD and the amount of time it took the learner to begin the response. Download the simple latency data sheet below to get started.
Interresponse time (IRT) measures the time between consecutive responses or the end of one instance of the behavior and the beginning of the next. This measurement allows you to measure how quickly the learner engages in multiple instances of the same behavior. For example, you may use interresponse time to increase how quickly a learner completes a math worksheet with 20 problems on it (by decreasing the interresponse time between math problems) or decrease how quickly a learner eats a meal (by increasing the interresponse time between bites of food).
Choosing Between Types of Continuous Data Collection Methods
When deciding on a continuous data collection method to use to measure a specific behavior, you need to consider several factors to ensure you choose the most appropriate method for your specific situation. Here are some considerations:
- Behavior being measured: The nature of the behavior you are tracking will influence your data collection method. Different behaviors may require different measurement techniques. For example, frequency recording may be suitable for tracking instances of a specific behavior, while duration recording may be more appropriate for behaviors that occur over a period of time.
- Measurement goals: Clarify your measurement goals and what specific information you need to gather. Are you interested in the frequency, duration, intensity, latency, or some other aspect of behavior? Different measurement methods are designed to capture different dimensions of behavior, so align your goals with the appropriate method.
- Feasibility and practicality: Consider the practicality and feasibility of different data collection methods given your available resources, staff experience, and the environment in which data collection will take place. Some methods may be more time-consuming or require specialized understanding, whereas others may be more straightforward and less resource-intensive.
- Reliability and accuracy: Think about the reliability and accuracy of the data collection method. Consider the potential for observer bias, human error, limitations of online data collection tools, or interference with the behavior being measured. Choose a method that minimizes these potential sources of error and maximizes the reliability of the data collected.
- Individual and setting factors: Take into account the characteristics of the learner or group you are working with, as well as the specific environment or setting in which the behavior occurs. Certain data collection methods may be better suited to different learners or settings.
- Ethical considerations: Ensure that the chosen data collection method respects ethical considerations and maintains the privacy and dignity of the individuals involved. Choose methods that minimize intrusiveness and are respectful of privacy, culture and confidentiality.
With the above considerations in mind, let’s look at the specific uses for each of the continuous data collection methods. The image below depicts a comparison between the different types of continuous data collection methods. The description below will help you interpret the image.
- Latency is represented as the time between the SD and the first response. In this example, 4 seconds.
- Duration is depicted as how long each response lasted. In this example, 9 seconds, 7 seconds, and 10 seconds. This is a total duration of 26 seconds or an average duration per occurrence of 8.6 seconds.
- The frequency is the number of times the response occurred. In this example, the frequency is 3.
- The rate is the number of time the response occurred over the period of time. In this example, the rate is 3 per minute.
- The interresponse time is represented by the time between responses. In this example, 3 seconds and 6 seconds which is an average IRT of 4.5 seconds.
Scroll through the images below to see each individual method separately.
There is not one “right” data collection method for a specific behavior. Choose a method that provides you with the information you need to determine if the intervention is sufficiently effective or if you need to change your strategies. Here are some general guidelines for each of the data collection methods:
- Choose latency if you’re primarily interested in how long it takes the learner to respond. This may include:
- Time from antecedent (trigger) until learner engages in target behavior
- Time from teaching instruction until the learner initiates following the instruction
- Time from sitting at the table until the learner initiates eating
- Choose duration if you’re primarily interested in how long a behavior lasts. This may include:
- Aggressive episodes that last for extended periods
- Time spent reading
- Choose frequency if you’re primarily interested in how often a behavior occurs and the observation times remain a constant length of time. This may include:
- Number of times flopping occurs during a school day
- Number of mands that occur in each 3 hour session
- Number of times a learner initiates an interaction with a peer during a 20 minute recess period
- Choose rate if you’re primarily interested in how often a behavior occurs and the observation times vary in length. This may include:
- Number of times the learner throws an object not intended to be thrown during a session
- Number of times the learner had toileting accidents between school and the time he went to bed
- Number of times the learner called out in class when the school has rotating double block periods so some class times are longer than others
- Choose interresponse time if you’re primarily interested in how much time passes between consecutive responses of the same behavior. This may include:
- Time between consecutive bites of food
- Time between getting out of the chair during class
- Time between incidents of SIB
The above are simply examples of when you might choose to use each of the measurement systems. The measurement system you choose might vary if, for example, when the learner flops he tends to remain on the ground for extended periods that vary in length. If this were the case, duration data might be a more appropriate measurement.
Want a resources that will help you conduct an FBA and create a function-based BIP? Check out our Master ABA Dojo membership! *
Discontinuous Data Collection
Discontinuous data collection systems measure only a sample of behavior that occurs by breaking the session down into small increments of time. Although these data are potentially less accurate than continuous data collection methods, they are easier to collect in busy environments. There is an inherent error in each method of discontinuous measurement (Fiske & Delmolino, 2012). When choosing a discontinuous measurement method, consider these errors carefully.
The chart below describes these errors.
|Discontinuous Measurement Method||Type of Error||Use for:|
|Partial Interval Recording||Overestimates the occurrence of behavior||Behavior decrease|
|Whole Interval Recording||Underestimates the occurrence of behavior||Behavior increase|
|Momentary Time Sampling||Neither overestimates nor underestimates the occurrence of behavior||High frequency, behavior increase|
Watch the video below for an example of the errors created by each of these methods.
Partial interval data breaks the session into equal parts (intervals). Record if the behavior occurred at any point during that interval. Since the behavior only needs to occur once or for a small fraction of the interval, partial interval data overestimates the occurrence of behavior. Use partial interval recording when:
- The behavior does not have a clear start and stop
- The behavior occurs at such a high rate that it’s impractical to attempt to count each occurrence
- An estimate of the frequency of the behavior is acceptable
Keep in mind that because partial interval data provides an overestimate of the occurrence of behavior, you want to use the smallest interval that is practical for your situation. The larger the interval, the more inflated the data. Often, due to the overestimation of this method, professionals use partial interval to document behaviors targeted for reduction. Examples of behaviors you might record using partial interval data include the occurrence of stereotypies or screaming across an entire day, if either behavior occurs at a high rate.
Because staff only need to attend to the behavior if it occurs, partial interval recording can be more efficient for busy staff to collect than monitoring for and counting each occurrence of a given behavior.
Whole interval data again breaks the session into equal parts (intervals). Record if the behavior occurs throughout the whole interval. Since the behavior must occur for the entire amount of the interval, this method underestimates the occurrence of the target behavior. Use whole interval recording when:
- The behavior occurs over long periods of time
- It’s impractical to use duration recording in your setting
- An overestimate of the behavior is acceptable
Because this method underestimates the occurrence of the behavior you want to use the smallest interval that is practical for your situation to ensure the most accurate reflection of the behavior. Often, due to the underestimation of the occurrence of the behavior, professionals use whole interval to document behaviors target for increase. This might include behaviors such as amount of time spent engaged in table work or functional play, assuming that these occur over significant periods of the child’s day.
Momentary time-sampling takes a quick snapshot of whether or not a behavior occurs. Identify an appropriate interval based on baseline data. When the interval is over, record whether or not the behavior is occurring at that time. This data collection method neither over nor underestimates the behavior; however, because not every instance of the behavior is recorded, the data are far less accurate than continuous data collection. Use momentary time-sampling when:
- Other methods of data collection are impractical in your situation
- You rely on someone else to collect the data who is unable to continuously monitor the behavior due to other responsibilities
- It’s not necessary to ensure you get a complete recording of the behavior
Momentary time-sampling does not provide you with reliable data; however, busy professionals are able to collect data about behavior when they don’t have the ability to attend to the child for extended periods of time. Momentary time-sampling may provide sufficient information for behaviors such as working independently at school or playing alone at home.
Choosing Discontinuous Data Collection Methods
Selecting an appropriate discontinuous data collection method depends on the specific clinical objectives, the behavior being measured, and the practical constraints of the situation. Discontinuous data collection methods are typically used when continuous measurement is not feasible. Here are some considerations to help you decide which discontinuous data collection method to use:
- Partial Interval Recording: This method involves dividing the observation period into short intervals and recording whether the behavior occurred at any time during each interval. It is suitable when you are interested in estimating the occurrence of behavior within a given time frame. Partial interval recording tends to overestimate behavior occurrence so it is best used for behaviors targeted for reduction.
- Whole Interval Recording: In this method, you record whether the behavior occurred continuously throughout the entire interval. It is appropriate when you want to ensure a higher level of accuracy by documenting if the behavior is maintained throughout the entire interval, but requires someone to watch the learner for the entire interval. Whole interval recording tends to underestimate behavior occurrence so it is best used for behaviors targeted for increase.
- Momentary Time Sampling: This method involves recording whether the behavior is occurring at the exact moment when each predetermined interval ends. It is useful when the person responsible for recording data has many other responsibilities.
When selecting a method, consider the following factors:
- Behavior characteristics: Different data collection methods are more suitable for different behaviors. Consider whether the behavior is continuous or discrete, the duration of the behavior, and whether it occurs in bursts or intermittently.
- Resources and practical constraints: Consider the available time, personnel, and other resources. Some methods may require more intensive data collection efforts than others.
- Research or clinical goals: Clarify your objectives. Are you interested in overall occurrence, patterns, or specific points in time when the behavior occurs?
Remember to choose a method that is reliable, practical, and aligns with your specific objectives.Back to Top
Other Data Collection Methods
The above data collection methods provide the widest application for learning about the occurrence of an identified behavior. The list above meets most of the data collection needs of professionals in the field of ABA. Other methods capture information missed when using those methods. The below data collection systems are used less frequently and for more specific purposes than the methods listed above.
ABC Data Collection
ABC data is often a critical component when conducting a functional behavior assessment (FBA). This data collection method looks at what happens right before and right after the behavior you’re interested in. This allows for analysis of the context of the behavior to begin to determine a possible function. Although there are many ways to collect ABC data, one simple method is to create a form with checkboxes for commonly occurring antecedents, behaviors, and consequences. Not only does this make data collection simpler, but it also provides an easier method for analyzing these data.
A scatterplot provides information of the occurrence of behavior across different parts of the day, either time frames or activities. This method allows for a visual analysis to determine if patterns exist. The example below breaks the day into 1 hour blocks of time and then provides space to compare data across an entire week. This data sheet also provides space to document location. This allows you, at a glance, to see that the highest rate of behavior occurs from 7-8 pm at home. While it doesn’t give you a specific count of behavior, this information allows you to determine when you should look to collect that more specific data.
Permanent product data provides a way for the professional to evaluate the occurrence of behavior after it has stopped. With this method of data collection, the professional does not need to be available to observe the behavior as it occurs. Schools use a lot of permanent product data recording for this reason. A teacher is unable to observe each of her students as they work, but she can look at the permanent products they produce (i.e. worksheets, projects, videos, etc.).
Probe data simply test to determine if a behavior occurs or does not occur in a given situation. In an effort to ensure that data collection does not interfere with teaching methods, a professional may choose to utilize a probe only data collection system for specific targets. If the professional chooses to do a probe prior to any teaching trials, we refer to this as a “cold probe.” Probe data allow for the professional to focus her attention on teaching methodology including errorless learning and prompt fading techniques. This data system is most beneficial when there are a limited number of individuals working with a client and who don’t rely on the data to know the correct prompt level to use during teaching.Back to Top
Advantages and Disadvantages of Each Type of Data Collection Method
Each data collection method has its own unique advantages and disadvantages. Consider these carefully before determining which system to use.
~Sensitive to small
changes in behavior
~Difficult to use without
|~Easier to use in a|
~Able to track very high
|~Only an estimate of|
~Must consider over or
under estimation when
~May need more time to
see changes in behavior
5 Ways to Make Frequency Data Collection Easier and More Discrete
Identifying the obstacles to accurate data collection helps reveal creative solutions to over come them. While you may experience specific obstacles in your practice, two obstacles seem to occur across various types of ABA programs. Often staff have the most difficulty in accurate data collection when they need to collect frequency data for high frequency behaviors or when the act of collecting the data becomes reinforcing for the child.
High Frequency Behaviors
Many children with autism engage in a variety of maladaptive behaviors that occur at too high a rate. Often behavior change occurs gradually over time. In order to determine the effectiveness of a behavior reduction plan, the data that are collected must be accurate. Although frequency and rate data collection may not be the most practical method for collecting data for high frequency behaviors, it is the most sensitive to behavior change, provided that the data are accurate.
Data Collection Becomes Reinforcing
Many children with autism don’t pay attention to data being collected by a professional. Other children find any form of attention motivating. When these children associate their behavior with the behavior of staff, the result may be an increase in this behavior. Traditional data collection techniques require staff to distinctly make some type of mark or electronic record. These methods lack the subtlety needed for children attuned to staff behavior.
Data Collection Techniques
Here are 5 options for easier and more discrete data collection. Each of these techniques offers its own unique advantages and disadvantages. Try them and see what works best for you!
1. Clicker Counters
Clicker counters are a great tool for counting high frequency behaviors and can easily be used to calculate rate (just calculate frequency/time). These clickers are a great way to track a variety of behaviors that occur frequently. You simply assign each behavior a color and click when the behavior occurs. They include a hook that you attach to a carabiner so you can attach them to a pocket or belt loop. These are affordable and available on Amazon . Their major disadvantage is the clicking sound that they make. Avoid these for children whose behavior is reinforced by staff collecting data.
Alternatively, digital finger counters provide the subtly you may need, but these counters can be sensitive and you risk counting behavior that doesn’t occur. If worn on a thumb, you may be less likely to accidentally hit the button. Again, these handy tools are inexpensive and easy to find on Amazon .
2. Small Objects in Pockets
Check out this low-tech option for tracking the occurrence of behavior. Put a collection of small objects in one pocket. As behavior occurs, transfer the corresponding number from that pocket into the other pocket.
This method offers some subtlety for well trained staff. To optimize discretion, staff put their hand in their pocket and carefully scoop one item into their hand as behavior occurs. Once the child looks away, staff move the items from that pocket to the other. The more frequently the behavior occurs, the smaller the objects must be.
With this option, you risk accidentally dropping the items either back into the original pocket or on the floor when transferring them. In addition, you must count each item at the end of the session. While this creates additional work, it may be the best short-term option if you need a low-tech, discrete data collection method.
3. Beads on a Pipe Cleaner
Sliding beads on a pipe cleaner offers another low-tech option for frequency data collection. When done well, it appears as though staff are simply fidgeting with the beads or doing a craft while not attending to the child’s behavior. Staff can slide a group of beads onto the top of the pipe cleaner and as behavior occurs, slide the beads to the bottom.
While this option may be reinforcing for staff as it can offer a calming effect for some, children may pick up on the fact that each time behavior occurs, staff pick up the beads. There are 2 ways to combat this effect: rotate between different low-tech options or have staff play with the beads throughout the day when behavior does not occur.
Technology offers a broad array of options from simple to complex. Many apps provide access to different methods to tally behavior as it occurs. Some apps export or graph this data for you as well. A simpler option is to open a note taking app and add an emoji or other character each time the behavior occurs.
Similar to the small objects method, this method requires staff to count the occurrences at the end of the session. This method offers some other nice advantages for children who attend to staff behavior. Adults on technology (phones, tablets or computers) is so common place that it essentially becomes unnoticeable to many children. In addition, children who are motivated by technology may be unpleased to see that the adult has found her own entertainment while he engages in the behavior.
5. Small Elastics on Fingers
A final low-tech and inexpensive option is to place small elastics on your fingers (hair elastics intended for young children work well). Place spares on one hand and as behavior occurs, roll them over to the other hand. To the child, this may appear as simple fidgeting.
This method may be inefficient for behaviors that occur at a very high frequency. In addition, some staff may find them uncomfortable on their fingers. This system also requires staff to count each elastic at the end of the session. Despite these disadvantages, you may find that this method works best for your specific circumstances.Back to Top
Research in Data Collection Methods
Several studies evaluate the use of the different data collection methods in research studies. Two studies evaluate this trend during different time periods. Kelly (1977) looked at the research published in The Journal of Applied Behavior Analysis from 1968-1975 and Mudford, Taylor, and Martin (2009). The results of their research are presented in the table below.
|Time Period||Continuous Data Collection Methods||Discontinuous Data Collection Methods|
Across the 40 year span from the start of the first study to the end of the follow-up study, researchers balanced the use of continuous and discontinuous data collection methods. Although discontinuous data collection methods have their value, they fail to quantify the basic dimensions of behavior (Fiske & Delmolino, 2012). With the introduction of electronic data collection systems, continuous data measures are more practical and efficient than they were when only paper and pencil technology existed. Although this should lead to researchers relying more on continuous data collection measures, the studies reveal that it’s not necessarily the case.
Factors to Consider When Choosing Between Continuous and Discontinuous Data Collection Methods
When determining which data collection method fits your needs, you must consider many factors including:
- Is the behavior potentially dangerous?
- Does the behavior threaten the placement of the individual?
- How frequently does the behavior typically occur?
- Does the behavior occur over a period of time?
- Does the behavior have a clear beginning and end?
- Who will be collecting the data?
- How long does the behavior usually last?
- Is it a behavioral deficit or excess?
Fiske and Delmolino (2012) provided clear guidelines for choosing between a continuous and discontinuous data collection method. The table below is a description of their recommendations.
|Continuous Data Collection Method||Discontinuous Data Collection Method|
|Discrete behaviors with a clear onset and offset||Ambiguous breaks between the occurrence of the behavior|
|Interventionist can accurately record each instance||The behavior occurs at a very high rate|
|Recording behaviors individually||Recording multiple behaviors simultaneously|
|Interventionist responsible for 1 learner||Interventionist required to complete many tasks at once|
Serious, dangerous or severe behavior requires a system that provides accurate data. Strongly consider using continuous data collection when addressing these types of behavior. Behaviors that occur at an exceptionally high rate may require a discontinuous data collection method for accuracy. If you rely on parents or teachers to collect data, you should consider discontinuous methods. Taking all of these factors into consideration allows you to select the most effective and efficient data collection system for your ABA program.Back to Top
Ethical Considerations When Choosing Data Collection Methods
The table below presents some important ethical considerations when choosing data collection methods. The table includes specific action steps to help you ensure you practice in an ethical way.
|Ethical Concern||Description||Action Steps to Ensure Ethical Practice|
|Feasibility||Data collection systems must be feasible to use in the setting where they will be used.||– Implement strict protocols for data storage, access, and sharing to protect participants’ privacy. <br>- Anonymize or de-identify data whenever possible to reduce the risk of identifying individual participants.|
|Validity and Reliability||Ensuring that data collection methods accurately measure what they intend to measure and produce consistent results over time and across different observers.||Consider the resources available in the setting when making a decision about which data collection system to use.|
|Cultural Sensitivity||Considering cultural norms, values, and practices when selecting data collection methods to avoid potential harm or discomfort to participants from different cultural backgrounds.||– Conduct a cultural assessment to understand the cultural context and preferences of participants. |
– Modify data collection methods to be culturally sensitive and respectful.
|Bias and Objectivity||Minimizing bias in data collection by maintaining objectivity and avoiding personal or professional biases that may influence the collection or interpretation of data.||– Train data collectors on the importance of objectivity and the potential for bias. |
– Implement inter-rater reliability checks to ensure consistency and minimize bias between different observers.
|Transparency and Full Disclosure||Providing transparent and complete information to participants about the purpose, scope, and potential uses of the collected data, including any data-sharing practices or data ownership rights.||– Clearly communicate to participants how their data will be collected, used, and shared. |
– Obtain explicit consent for any secondary use or sharing of data beyond the original purpose.
|Voluntary Participation||Ensuring that participation in data collection is voluntary and participants have the right to withdraw their participation at any time without negative consequences.||– Clearly communicate to participants that their participation is voluntary and they can withdraw at any time without penalty. |
– Respect participants’ decisions to withdraw and provide a straightforward process for withdrawal.
|Minimizing Harm||Taking measures to minimize any potential harm or negative consequences to participants during the data collection process.||– Conduct a risk assessment to identify potential sources of harm and implement measures to mitigate those risks. |
– Monitor participants closely for any signs of distress or discomfort and provide support or referrals as needed.
|Beneficence and Utility||Ensuring that the data collection methods and resulting data provide meaningful insights, benefits, or contributions to the field of study or the participants themselves.||– Conduct a thorough review of the potential benefits and utility of the data collection methods. |
– Regularly evaluate the impact and usefulness of the data collection methods and make adjustments if necessary.
|Data Integrity and Accuracy||Ensuring that data is collected accurately, recorded appropriately, and protected from any intentional or unintentional alterations or falsifications.||– Implement data quality checks and validation procedures to verify the accuracy and integrity of collected data. |
– Protect data from unauthorized access or tampering through secure data storage and access controls.
|Transparency in Data Analysis||Conducting data analysis with transparency, avoiding selective reporting or manipulation of data to fit predetermined hypotheses, and ensuring a comprehensive and unbiased interpretation of the results.||– Follow established data analysis procedures and guidelines to ensure transparency and rigor. |
– Clearly report the methods, results, and limitations of the data analysis to promote transparency and reproducibility.
By considering and implementing these action steps, BCBAs can promote ethical practice in choosing data collection methods and ensure the protection, rights, and well-being of the learners they serve.Back to Top
Research Related to Choosing Data Collection Methods
Below is a table summarizing research articles related to choosing data collection methods. The table includes important action steps to help you put these ideas into practice.
|Article Title||Summary||Action Steps for Applying Information|
|Use of discontinuous methods of data collection in behavioral intervention: Guidelines for practitioners||The article provides guidelines for practitioners on using discontinuous methods of data collection in behavioral interventions. It discusses considerations for choosing appropriate data collection methods, including partial interval recording, whole interval recording, and momentary time sampling.||Consider the context and objectives of the intervention when selecting a data collection method. Ensure practitioners are trained in using discontinuous methods accurately and consistently. Regularly review and update data collection procedures based on the specific needs of the individuals receiving the intervention.|
|An evaluation of estimation data collection when measuring problem behavior in a classroom setting||This article evaluates the use of estimation data collection for measuring problem behavior in a classroom setting. It compares the accuracy and efficiency of estimation data collection with direct observation and discusses the implications for practitioners.||Consider the feasibility and practicality of using estimation data collection in classroom settings. Assess the accuracy and reliability of estimation data collection by comparing it with direct observation methods. Determine if estimation data collection can provide sufficient information for decision-making and intervention planning.|
|A review of the observational data‐collection and reliability procedures reported in the Journal of Applied Behavior Analysis||This article reviews observational data collection and reliability procedures reported in the Journal of Applied Behavior Analysis. It provides insights into common practices and recommendations for improving observational data collection and reliability.||Familiarize yourself with established observational data collection procedures. Implement systematic training for observers to enhance reliability. Regularly assess interobserver agreement and make adjustments as needed. Consider using validated data collection tools and software to improve accuracy and efficiency.|
|Data collection and measurement assessment in behavioral research: 1958–2013||The article presents an analysis of data collection and measurement assessment practices in behavioral research from 1958 to 2013. It highlights trends, challenges, and recommendations for improving data collection and measurement procedures.||Stay updated on evolving data collection and measurement assessment practices in the field. Implement evidence-based techniques for data collection and measurement. Regularly review and adapt data collection procedures to align with current best practices. Seek professional development opportunities to enhance knowledge and skills in data collection and measurement assessment.|
|Procedures and accuracy of discontinuous measurement of problem behavior in common practice of applied behavior analysis||This article examines the procedures and accuracy of discontinuous measurement of problem behavior in applied behavior analysis. It provides recommendations for practitioners to improve the reliability and validity of discontinuous measurement methods.||Ensure practitioners are trained in accurate implementation of discontinuous measurement methods. Regularly assess and monitor the reliability and validity of discontinuous measurement data. Consider the limitations and potential biases associated with discontinuous measurement and make appropriate adjustments.|
|The representativeness of observational samples of different durations||The article investigates the representativeness of observational samples of different durations. It discusses the implications of sample duration on the accuracy and generalizability of observational data.||Carefully consider the duration of observational samples to ensure they adequately represent the behavior of interest. Balance the need for detailed data with practical constraints. Conduct pilot studies to determine optimal sample durations based on the specific behavior and context.|
|Continuous recording and interobserver agreement algorithms reported in the Journal of Applied Behavior Analysis (1995–2005).||This article examines continuous recording and interobserver agreement algorithms reported in the Journal of Applied Behavior Analysis from 1995 to 2005. It provides insights into the use of continuous recording methods and their impact on interobserver agreement.||Familiarize yourself with various continuous recording methods and algorithms used in behavior analysis. Train observers on accurate implementation of continuous recording procedures. Regularly assess interobserver agreement to ensure consistency and reliability. Adjust continuous recording procedures based on feedback and observations to optimize interobserver agreement.|
|A comparison of frequency, interval, and time‐sampling methods of data collection||This article compares frequency, interval, and time-sampling methods of data collection. It examines the advantages, disadvantages, and considerations for each method in different contexts.||Evaluate the specific goals and requirements of the data collection task to determine the most appropriate method (frequency, interval, or time-sampling). Consider the behavior being measured and the resources available for data collection. Choose a method that balances accuracy and practicality. Regularly review and analyze the collected data to ensure it aligns with the research or intervention objectives.|
|A comparison of data collection techniques used with discrete trial teaching||The article compares different data collection techniques used with discrete trial teaching in the context of autism spectrum disorders. It discusses the advantages and limitations of various methods and provides recommendations for practitioners.||Familiarize yourself with different data collection techniques applicable to discrete trial teaching. Select a method that aligns with the specific goals and characteristics of the individuals with autism spectrum disorders. Ensure accurate implementation of the chosen method through training and ongoing supervision. Regularly evaluate the reliability and validity of the collected data to inform decision-making and intervention adjustments.|
References and Related Reading
Fiske, K., & Delmolino, L. (2012). Use of discontinuous methods of data collection in behavioral intervention: Guidelines for practitioners. Behavior Analysis in Practice, 5(2), 77-81.
Griffin, A. (2020). An evaluation of estimation data collection when measuring problem behavior in a classroom setting. Behavior Analysis in Practice, 13(4), 724-732.
Kelly, M. B. (1977). A review of the observational data‐collection and reliability procedures reported in the Journal of Applied Behavior Analysis. Journal of Applied Behavior Analysis, 10(1), 97-101.
Kostewicz, D. E., King, S. A., Datchuk, S. M., Brennan, K. M., & Casey, S. D. (2016). Data collection and measurement assessment in behavioral research: 1958–2013. Behavior Analysis: Research and Practice, 16(1), 19
LeBlanc, L. A., Lund, C., Kooken, C., Lund, J. B., & Fisher, W. W. (2020). Procedures and accuracy of discontinuous measurement of problem behavior in common practice of applied behavior analysis. Behavior Analysis in Practice, 13(2), 411-420.
Mudford, O. C., Beale, I. L., & Singh, N. N. (1990). The representativeness of observational samples of different durations. Journal of Applied Behavior Analysis, 23(3), 323-331.
Mudford, O. C., Taylor, S. A., & Martin, N. T. (2009). Continuous recording and interobserver agreement algorithms reported in the Journal of Applied Behavior Analysis (1995–2005). Journal of Applied Behavior Analysis, 42(1), 165-169.
Repp, A. C., Roberts, D. M., Slack, D. J., Repp, C. F., & Berkler, M. S. (1976). A comparison of frequency, interval, and time‐sampling methods of data collection. Journal of Applied Behavior Analysis, 9(4), 501-508.
Taubman, Mitchell T., Ronald B. Leaf, John J. McEachin, Sasha Papovich, and Justin B. Leaf. “A comparison of data collection techniques used with discrete trial teaching.” Research in Autism Spectrum Disorders 7, no. 9 (2013): 1026-1034.