USA: +1(669)289-8683 
Sign in
(Experimental Design and AB Testing)
Overview
In this assignment, we will look into how to design a study that will help you to answer a research question. For this assignment, you will focus on designing a simple AB test for getting respondents to respond to your survey that you designed for the last assignment. For all of the tasks below, you will include your results in a single pdf document.
Optional readings
Here is a list of optional readings if you would like to do more on this topic:? Universal Methods of Design : 100 Ways to Explore Complex Problems, Develop
Innovative Strategies, and Deliver Effective Design So by Bruce Hanington , and Bella Martin (ebook through the library)
Grading breakdown
You will be graded on the completeness and correctness of each part of the assignment. When you finish the assignment, you will turn in a document that includes the following information.
? 2 pts – Description of the research question and hypothesis
? 6 pts – Description of the independent, dependent, and control variables. You will not get full credit if you do not correctly identify your independent and dependent variables or if you miss key control variables that will impact your ability to compare your conditions.
? 1 pt – Description of the study design
? 4 pts – Description and inclusion of the materials that align with the study design and account for the different variables
? 4 pts – Description of the procedure and how the outcome will be collected and measured.
? 1 pt – Extra credit – Run the AB test and share the results! Tasks
What is your hypothesis? Your hypothesis is what you think the answer to your research question will be. Explain why you think this, ideally backing it with evidence.
For your study, are you going to use a within or between subject design and why? Have you considered all of the design factors you might need for your chosen design?
Description of how the dependent variable will be collected.
Assignment 2 (Survey Design)
Write a short paragraph about what the goal of your survey is. For example, do you want
to understand how in-person classes progress across classes? Do you want to understand
how an instructor could change a particular class?
the goal of the survey is to find out if students feel that they are getting value for money,
considering how instructors have been delivering in class for the time the semester has elapsed.
By asking students questions, I will understand what the instructors must keep doing and what
needs to change. For example, in the teaching profession, instructors are encouraged to use
different learning styles so that students can understand concepts faster and execute them better
in their careers much later. By asking students what they are most comfortable with, the
management will understand whether they should invest in all the learning styles or limit things
to one or a few. For example, a lot of money may be wasted on using all the teaching styles
while only two are effective.
Overall, my survey aims to understand how the college can increase the quality of
student services. Another reason this survey is important is that it will help us check our
expenditure as the management to determine if we are spending money on the right pedagogy.
What is more, the survey will find out the opinion of students concerning online classes or
otherwise. Finally, the survey will help us determine if the students feel they are affiliated with
an institution that complies with all the rules and regulations set aside to measure the
effectiveness of a university or college. Overall, the survey will effectively determine if we are
doing things right and whether the clientele is confident in our abilities. Note that if we are doing
things right, there is a high chance that we will get repeat clientele and attract new ones.
Based on the goals of your survey identified above, what concepts are you trying to
measure? List these concepts with a sentence explaining each. Build out a hierarchy if it is
helpful to break them down into sub-concepts.
Putting into consideration the goals of my survey that I have identified above, the concepts that I
am trying to measure are as listed below:
Pedagogy
Explanation: There is an attempt to measure the pedagogy used for its effectiveness.
Precisely, there are concerns about whether the management has recommended the teachers use
the right teaching styles. Note that no matter how talented a teacher is or how knowledgeable
they concern about a particular subject, they will not deliver to students if they teach in a difficult
way for them to understand. While education departments and government inspectors are usually
concerned about the curriculum used, pedagogy is important because it determines whether
students value their money.
Customer satisfaction
Explanation: As management, we must understand if all our customers are satisfied. It
will be possible to tell whether we are doing a good job depending on the number of students that
will give positive reviews and the customers that will give negative reviews. For example, out of
a sample n of respondents selected for the survey, at least 50 per cent should have a positive
response about the institution. However, a 50 per cent score is analogous to grade C and is not
good enough. At least 80 per cent of the respondents should think positively about the classes
offered.
Economies of scale
Explanation: The management wants to determine whether it uses its resources
effectively. Thus far, much money is being used to offer online classes and present a pedagogy
grounded on reading and writing, kinesthetic learning, auditory learning, and visual learning. If
the survey reveals that all these methods are effective, then all is well and good. However, if the
survey reveals that some of these methods are not as effective and are just unnecessarily adding
to the bulk of the students’ learning, they must be scrapped completely.
Public relations
Explanation: For any given institution, public relations must be exceptional. The people
within and without the institution should have positive things to say about it. During the
interviews, the students should have positive things to say about the classes offered, the
assignments given, and how they interact with the teachers. If the PR is not good, it is risky for
the business because there is no guarantee that the existing students will put in a good word for
us. As such, the survey was conducted hoping that most students would have something good to
say about the college.
Create a survey to measure the concepts you identified. For this survey, you must use at
least ten questions. In your pdf document, list the question and what concept it is
measuring.
Link to the survey:
Assignment 2 (Survey Design)
Which year of university are you in?
Freshman
Sophomore
Junior
Senior
What were your expectations about the University of ___ prior to becoming a Torero?
Your answer
What do you think about the University of ___ now?
Your answer
Have your expectations matched your current experiences at the University of ___?
Yes
No
Do you agree that the University of ___ is among one of the best schools in the entire nation?
Strongly disagree
Disagree
Neutral
Agree
Strongly agree
What is your most favorite place on the campus? (Please explain your answer)
Your answer
What is your least favorite place on the campus? (Please explain your answer)
Your answer
What could the University of ___ do in order to make this institution a better place for all
students?
Your answer
What learning method helps you commit content more easily to your photographic memory?
Read and Write
Kinesthetic
Visual
Auditory
Do you like the instructor lecturing more or giving more assignments?
I prefer more lectures
I prefer more assignments
I prefer a balance of the two
None of the above (explain)
Does the material that the instructor teaches in class match the random assessment test, and
the final exam you are given?
Yes, they do
No, they do not
Are your instructors committed to helping you to get a better grade?
Yes, they are committed
No, they are not committed
Do you feel that you are in the best institution of higher learning? (Please explain your answer)
Your answer
Do you think you are getting the value for your money?
Yes
No
What is the most impressive thing about University of ___ of higher learning?
Instructors
Culture
Competence
Certifications at the end of the courses
What would make you recommend University of ___ to a friend or family member? (Please
explain)
Your answer
Do you think the University of ___ has matched the tuition fee that is charging with the
education and services that it is giving?
Yes
No
Would you say all the learning equipment you need for your course is at your predisposition?
(Please explain your answer)
Your answer
What financial challenges have you seen your fellow students undergo?
Your answer
Would you recommend the University of ___ as capable of giving high-quality education?
Yes, I would
No, I would not
Would you recommend, through Word of Mouth or online review, that this school offers the best
tuition prices?
Yes, I would
No, I would not
Would you say that apart from the state of art brick and mortar facilities such as libraries,
University of ___ also offers locational advantages through online classes?
Yes, I would
No, I would not
Would you say that this learning institution has a good name?
Yes
No
In the survey, you will create the question and answer choices. You will be graded on the
alignment of the question format with what you are trying to measure and the alignment of
the question with the guidelines discussed in class.
Link to the survey:
Assignment 3
(Experimental Design and AB Testing)
Overview
In this assignment, we will look into how to design a study that will help you to answer a
research question. For this assignment, you will focus on designing a simple AB test for getting
respondents to respond to your survey that you designed for the last assignment. For all of the
tasks below, you will include your results in a single pdf document.
Optional readings
Here is a list of optional readings if you would like to do more on this topic:
● Universal Methods of Design : 100 Ways to Explore Complex Problems, Develop
Innovative Strategies, and Deliver Effective Design So by Bruce Hanington , and Bella
Martin (ebook through the library)
Grading breakdown
You will be graded on the completeness and correctness of each part of the assignment. When
you finish the assignment, you will turn in a document that includes the following information.
● 2 pts – Description of the research question and hypothesis
● 6 pts – Description of the independent, dependent, and control variables. You will not get
full credit if you do not correctly identify your independent and dependent variables or if
you miss key control variables that will impact your ability to compare your conditions.
● 1 pt – Description of the study design
● 4 pts – Description and inclusion of the materials that align with the study design and
account for the different variables
● 4 pts – Description of the procedure and how the outcome will be collected and
measured.
● 1 pt – Extra credit – Run the AB test and share the results!
Tasks
1. What is your research question? In other words, for your AB test, what are you
interested in comparing? (E.g., Does sharing the survey over twitter or instagram lead to
more answers?)
2. What is your hypothesis? Your hypothesis is what you think the answer to your research
question will be. Explain why you think this, ideally backing it with evidence.
3. Based on your research question, what are your independent, dependent, and control
variables? Make sure that what you list is concrete. The dependent variable cannot be
“survey results” but it could be “number of people to complete the survey”. For the
control variable, mention what factors you will make sure that you keep the same
between your conditions so they do not bias the results.
4. For your study, are you going to use a within or between subject design and why? Have
you considered all of the design factors you might need for your chosen design?
5. Now that you have designed your study, you can make your materials and procedure!
For each condition that you want to test, what will it look like? This can be including the
text that you will send out or an image of what it will look like. Basically, you need to
describe each condition and explain how you are aligning with your control variables.
Second, how will you share the two different conditions? Again, how will you take into
account your control variables?
6. Description of how the dependent variable will be collected.
7. (Optional) Run your AB test. If your design requires you to manually share the survey,
you will need to send it to at least 10 people in each condition. Share what the outcome
is! Did it align with your hypothesis? Were you surprised?
Turn it in
Turn in the assignment through Blackboard under assignment 3. It is due next Thursday. Please
submit it as a pdf.
I
