4.2.3 Formulating Questions and Data Evaluation

Introduction

Formulating questions guides data exploration and analysis. Before you can analyze data, you need to know what you are trying to find out. Good questions give direction to the analysis and ensure that the data collected is relevant and useful.

The textbook explains that after formulating questions, you identify relevant data sets to answer these questions. Then you evaluate how well the data addresses the questions posed. You compare new data with previous findings to see if they align or not. The questions are used to focus on specific data insights and trends. They are refined after evaluation to ensure data quality.

Definition

Formulating Questions is the process of defining clear, specific questions that guide data exploration and analysis.

Data Evaluation is the process of assessing how well the collected data answers the formulated questions, checking for quality, relevance, and consistency.

In simple words: Formulating questions means deciding what you want to find out. Data evaluation means checking whether the data you collected actually answers those questions.

Main Idea

The core idea is that good questions lead to good analysis. Without clear questions, data analysis can go in the wrong direction, waste time, and produce irrelevant results.

• Formulate questions: Define what you want to find out.
• Identify relevant data sets: Determine what data is needed to answer the questions.
• Evaluate data quality: Check the data for missing values, inconsistencies, and accuracy.
• Compare with previous findings: See if the new data aligns with or contradicts previous findings.
• Refine questions: Adjust the questions based on what the data reveals.

Core Concept

The Process of Formulating Questions and Data Evaluation

• Specific: They focus on a particular aspect of the problem.
• Measurable: They can be answered with data.
• Relevant: They relate to the overall goal.

• Determining what data is needed.
• Finding sources of that data.
• Ensuring the data is accessible and usable.

• Checking for missing or inconsistent data: Are there gaps or errors in the data?
• Ensuring accuracy: Is the data correct and up-to-date?
• Verifying consistency: Does the data match across different sources?

• Validate the new data.
• Identify trends or changes over time.
• Detect anomalies or unexpected results.

Step 5: Refine Questions Based on the evaluation, the questions may need to be refined. This ensures that the analysis stays focused and relevant.

Example from the Book: School Breakfast Program The textbook provides a detailed example of formulating questions and evaluating data.

Context: A school wants to know if a breakfast program improves student attendance.

• Does participating in a school breakfast program improve student attendance?
• Which grade levels benefit most from breakfast programs in terms of attendance?
• Do students from low-income families show greater improvement in attendance compared to their peers?

• Student attendance records.
• Breakfast program participation data.
• Demographic data (grade level, family income, etc.).

• Check for missing or inconsistent data.
• Ensure attendance records are accurate and up-to-date.
• Verify breakfast program participation data matches student records.

The textbook explains that this example demonstrates how formulating questions guides data exploration and analysis, leading to meaningful insights and informed decision-making.

• Guides data exploration: It tells you what to look for in the data.
• Focuses the analysis: It prevents the analysis from becoming too broad or unfocused.
• Ensures relevance: It ensures that the data collected is relevant to the problem.
• Improves data quality: It helps identify what data is needed and what quality standards are required.
• Leads to meaningful insights: It directs the analysis toward actionable findings.

• Data is often imperfect: It may have missing values, errors, or inconsistencies.
• Quality affects results: Poor-quality data leads to poor-quality insights.
• Accuracy matters: Decisions based on inaccurate data can be harmful.
• Consistency is key: Data from different sources must be consistent to be reliable.

Intermediate Level

The process of formulating questions and data evaluation can be summarized as:

Key point: The questions guide the entire analysis. Without clear questions, the analysis lacks direction.

Important Points

• - Formulating Questions: Defining clear, specific questions that guide data exploration and analysis.
• - Data Evaluation: Assessing how well the data answers the questions, checking for quality, relevance, and consistency.
• - Process:
• 1. Formulate questions.
• 2. Identify relevant data sets.
• 3. Evaluate data quality.
• 4. Compare with previous findings.
• 5. Refine questions.
• - Example: School breakfast program — questions about attendance, grade levels, and low-income families.
• - Data Quality Checks: Missing/inconsistent data, accuracy, consistency.
• - Why it matters: Good questions lead to good analysis; data quality affects results.

Remember

• - Formulating Questions = Deciding what you want to find out.
• - Data Evaluation = Checking if the data answers the questions.
• - Process: Formulate → Identify → Evaluate → Compare → Refine.
• - Example: School breakfast program — attendance, grade levels, income.
• - Data Quality Checks: Missing data, accuracy, consistency.
• - Good questions = Good analysis.
• - Data quality = Quality insights.

Common Mistakes

• 1. Starting analysis without clear questions — This leads to unfocused, irrelevant results.
• 2. Ignoring data quality — Poor-quality data leads to poor insights.
• 3. Not comparing with previous findings — This can lead to missed trends or anomalies.
• 4. Not refining questions — Questions may need to be adjusted as the analysis progresses.
• 5. Assuming data is always accurate — Data can be missing, inconsistent, or outdated.
• 6. Asking too many questions — This can make the analysis too broad and unfocused.

Quick Revision

• Formulating Questions: The process of defining clear, specific questions that guide data exploration and analysis.
• Data Evaluation: The process of assessing how well the collected data answers the questions, checking for quality, relevance, and consistency.
• Process:
• Example: School breakfast program — questions about attendance, grade levels, and low-income families. Data sets: attendance records, participation data, demographics. Data quality checks: missing data, accuracy, consistency.
• Why it matters: Good questions lead to good analysis; data quality affects results.

60-Second Revision

• Formulating Questions = Deciding what you want to find out.
• Data Evaluation = Checking if the data answers the questions.
• Process: Formulate → Identify → Evaluate → Compare → Refine.
• Example: School breakfast program — attendance, grade levels, income.
• Data Quality Checks: Missing data, accuracy, consistency.
• Warning: Don't start analysis without clear questions.

Frequently Asked Questions (FAQs)

Q1. What is formulating questions? Answer: Formulating questions is the process of defining clear, specific questions that guide data exploration and analysis. Good questions give direction to the analysis and ensure that the data collected is relevant and useful.

Q2. What is data evaluation? Answer: Data evaluation is the process of assessing how well the collected data answers the formulated questions. It involves checking for quality, relevance, and consistency.

• Formulate questions.
• Identify relevant data sets.
• Evaluate data quality.
• Compare with previous findings.
• Refine questions.

Q4. Why is formulating questions important? Answer: Formulating questions is important because it guides data exploration and analysis, focuses the analysis on specific insights and trends, ensures that the data collected is relevant, and leads to meaningful insights.

• Check for missing or inconsistent data.
• Ensure attendance records are accurate and up-to-date.
• Verify breakfast program participation data matches student records.

• Does participating in a school breakfast program improve student attendance?
• Which grade levels benefit most from breakfast programs in terms of attendance?
• Do students from low-income families show greater improvement in attendance compared to their peers?

• Student attendance records.
• Breakfast program participation data.
• Demographic data (grade level, family income, etc.).

Q8. Why is data evaluation important? Answer: Data evaluation is important because data is often imperfect — it may have missing values, errors, or inconsistencies. Poor-quality data leads to poor-quality insights, and decisions based on inaccurate data can be harmful.

• Q9. What is the purpose of comparing with previous findings?
• Answer: Comparing with previous findings helps to validate the new data, identify trends or changes over time, and detect anomalies or unexpected results.

Q10. What happens if the questions are not refined? Answer: If the questions are not refined, the analysis may stay too broad or unfocused, leading to irrelevant results. Refining questions ensures that the analysis stays focused and relevant.

Practice Questions

Short Response Questions (SRQs)

• Define formulating questions and data evaluation.
• What is the process of formulating questions and data evaluation?
• Why is formulating questions important?
• What data quality checks are mentioned in the textbook?
• Describe the school breakfast program example.

Extended Response Questions (ERQs)

• Discuss the process of formulating questions and data evaluation in detail. Why is each step important?
• Explain the importance of data quality evaluation. What happens if the data is of poor quality?
• Analyze the school breakfast program example. How do the questions guide data exploration and analysis?
• You are analyzing data for a school project. Describe how you would formulate questions, identify data sets, and evaluate data quality.
• Compare and contrast the roles of formulating questions and data evaluation. How do they work together?

Multiple Choice Questions (MCQs)

• Q1. What is formulating questions?
• A. Defining clear, specific questions that guide data exploration
• B. Collecting data
• C. Analyzing data
• D. Deleting data
• Correct Answer: A
• Explanation: Formulating questions is the process of defining clear, specific questions that guide data exploration and analysis.

• Q2. What is data evaluation?
• A. Assessing how well the data answers the questions
• B. Collecting data
• C. Deleting data
• D. Storing data
• Correct Answer: A
• Explanation: Data evaluation is the process of assessing how well the collected data answers the formulated questions.

• Q3. What is the first step in the process?
• A. Identify relevant data sets
• B. Formulate questions
• C. Evaluate data quality
• D. Refine questions
• Correct Answer: B
• Explanation: The first step is to formulate questions.

• Q4. What is the last step in the process?
• A. Identify relevant data sets
• B. Formulate questions
• C. Evaluate data quality
• D. Refine questions
• Correct Answer: D
• Explanation: The last step is to refine questions.

• Q5. Why is data evaluation important?
• A. It makes data more complex
• B. It ensures data quality and relevance
• C. It deletes data
• D. It stores data
• Correct Answer: B
• Explanation: Data evaluation is important because it ensures data quality and relevance.

• Q6. What does the textbook say about comparing new data with previous findings?
• A. It helps validate the new data and identify trends
• B. It deletes the data
• C. It makes the data more complex
• D. It stores the data
• Correct Answer: A
• Explanation: Comparing new data with previous findings helps validate the new data, identify trends or changes over time, and detect anomalies.

• Q7. In the school breakfast program example, what is the first question?
• A. Does participating in a school breakfast program improve student attendance?
• B. Which grade levels benefit most?
• C. Do students from low-income families show greater improvement?
• D. How many students participate?
• Correct Answer: A
• Explanation: The first question is: "Does participating in a school breakfast program improve student attendance?"

• Q8. In the school breakfast program example, what is the third question?
• A. Does participating in a school breakfast program improve student attendance?
• B. Which grade levels benefit most?
• C. Do students from low-income families show greater improvement in attendance compared to their peers?
• D. How many students participate?
• Correct Answer: C
• Explanation: The third question is: "Do students from low-income families show greater improvement in attendance compared to their peers?"

• Q9. Which data set is NOT mentioned in the school breakfast program example?
• A. Student attendance records
• B. Breakfast program participation data
• C. Demographic data
• D. Teacher salaries
• Correct Answer: D
• Explanation: Teacher salaries are not mentioned as a data set in the example.

Q10. What are the data quality checks mentioned in the textbook? A. Missing data, accuracy, consistency B. Data size, data type, data structure C. Data visualization, data analysis, data storage D. Data collection, data cleaning, data entry Correct Answer: A Explanation: The data quality checks are: check for missing or inconsistent data, ensure attendance records are accurate and up-to-date, and verify breakfast program participation data matches student records.

• Q11. Why should questions be refined?
• A. To ensure data quality
• B. To keep the analysis focused and relevant
• C. To delete data
• D. To store data
• Correct Answer: B
• Explanation: Questions should be refined to ensure that the analysis stays focused and relevant.

• Q12. What is the purpose of identifying relevant data sets?
• A. To determine what data is needed to answer the questions
• B. To delete data
• C. To make data more complex
• D. To store data
• Correct Answer: A
• Explanation: Identifying relevant data sets involves determining what data is needed to answer the questions.