End-line Evaluation Survey of UNFPA's Action for Adolescent Girl's (AAG) Initiative in Rajasthan and Odisha, 2017
UNFPA
End-line Evaluation Survey of UNFPA's Action for Adolescent Girl's (AAG) Initiative in Rajasthan and Odisha, 2017
Request for proposal
Reference:
UNFPA/IND/RFP/17/001
Beneficiary countries or territories:
India
Registration level:
Basic
Published on:
19-Apr-2017
Deadline on:
03-May-2017 17:00 (GMT 5.30)
Description
- Background of UNFPA’s asset building initiative with girls
UNFPA’s Action for Adolescent Girls (AAG) is an asset building initiative that seeks to empower vulnerable adolescent girls (10-19 years) with human, social, health and financial assets. The goal of the initiative is to ensure that girls experience healthier, safer and more empowered life-transitions free from the risk of child marriage and other harmful practices with the ability to make choices and decisions about their lives. The initiative is being implemented in two selected blocks (Kherwada and Salumber) of Udaipur district in Rajasthan and in one block (Gumma) of Gajapati district in Odisha. The programme engages intensively with girls through collectivization of girls, and transaction of life-skills; it also engages with parents and community members, and frontline workers, and with local administrative officials.
The AAG intervention is based on a peer led approach and following are the major strategies in the programme:
- Empowering girls with information, skills, and support networks
- Educating and mobilizing parents and community members
Since the initiation of these projects at various sites varies, therefore the timing of conducing end line evaluation survey in Rajasthan will be in the month of June 2017 while in Odisha the field work will be conducted in the month of October 2017. This terms of reference envisages the engagement of a suitable research agency to undertake the end line surveys in these two states in a phased manner. The objectives and methodology of the end line survey is described in detailed in the following sections.
- Objective of the end line study
Following are the objectives of the end line study of AAG’s intervention:
- To compare the key indicators related to knowledge, attitude and practices among adolescent girls, families and community members on issues related to their health and well-being with the benchmark values as to measure the success of the project after completion of the interventions
- Use rigorous statistical methods to derive the net effect of the intervention on adolescent girls.
Human assets- life-skills; Social assets- social networks, group membership, mentorship; health assets- enhanced access to age appropriate sexual and reproductive health information and services; financial assets- financial literacy and linkage to vocational skill building
Yogesh Bhatt - bids.india@unfpa.org, Tel: +91 46532235, Fax: +91 24628078
Email address:
bids.india@unfpa.org
First name:
Yogesh
Surname:
Bhatt
Telephone country code:
India (+91)
Telephone number:
46532235
Telephone extension
235
Fax country code:
India (+91)
Fax number:
24628078
80101606
-
Project monitoring and evaluation
The last date for submission of RFP has been extended till 1700 hrs on May 5, 2017
Edited on:
03-May-2017 07:32
Edited by:
srivastava@unfpa.org
3rd May 2017
QUERY BOARD : End Line Evaluation AAG intervention in Rajasthan and Odisha
Answers to the queries raised by probable bidders
The ToR mentions "Other respondents to be covered include- parents, community members including opinion leaders and PRI representatives, and frontline workers in 25 percent of the PSUs." (Page-2).
The community members (opinion leader, etc) can be covered using IDI.
Q1 Could you please indicate what tool was used to assess the KAP of the parents during the baseline.
We will have to apply the same tool during the end-line.
A1: All tools will be shared with the agency once selection process is over.
Edited on:
03-May-2017 06:52
Edited by:
srivastava@unfpa.org
2nd May 2017
QUERY BOARD : End Line Evaluation AAG intervention in Rajasthan and Odisha
Answers to the queries raised by probable bidders
Q1 The terms of reference states that samples have to be taken from 3 blocks of Udaipur District, Rajasthan and 2 Blocks of Gajapati District, Odisha are mentioned. Does the program of Action for Adolescent Girl's run in all villages of all GPs included in the 3 project blocks? We would request you to provide the geographic coverage of the programme in each of the 3 project blocks that are to be studied as part of this evaluation.
Ans1 : Two blocks in each state are considered as control block and in the remaining 3 blocks, the project is implemented in all villages, however, a representative sample will be drawn from each of the block. For this universe will be provided.
Edited on:
02-May-2017 07:14
Edited by:
srivastava@unfpa.org
QUERY BOARD : End Line Evaluation AAG intervention in Rajasthan and Odisha
Answers to the queries raised by probable bidders
Q1. Kindly confirm that we have to submit the document as follows :
One original : containing technical proposal and financial proposal
One copy : containing technical proposal and financial proposal
One Electronic copy (CD-Rom) Technical proposal and financial proposal
A1. Technical and financial proposals must be submitted separately. The bidder may please submit 2 copies each of technical and financial proposals.
Q2. On Page 2, Other Respondents to be covered include, parents, community members including opinion leaders and PRI representatives, frontline workers in 25% of the PSUs.
a. Please clarify whether we would be provided a separate questionnaire for these other respondents group or we need to cover using any qualitative tool.
Ans 2a: Draft questionnaire for qualitative study will be provided, which needs to be finalized in consultation with UNFPA.
b. If we need to use any quantitative or qualitative tool, whether agency has to develop that tool or it would be provided by UNFPA.
Ans:2b. The tools used baseline for quantitative and qualitative will be provided which will the basis of finalizing the tools.
c. Whether all the four categories of respondents i.e. parents, opinion leaders, PRI representatives, frontline workers would be covered in 25% PSUs OR any one of them will be interviewed in 25% PSUs.
Ans. 2c: Agencies are requested to propose an appropriate sample in 25% of PSU which will be used for evaluation of the technical proposal.
Q3. In point # 4. Confidentiality an Ethical Considerations it is given that Ethical clearance of the tools have been sought by UNFPA however any additional clearance within the agency will be the responsibility of the agency.
a. Please clarify whether UNFPA has taken or will be taking IRB approval in India or will it be the responsibility of Agency.
Ans 3a: Please read the section about ethical clearances (as indicated above) carefully and the agency will be able to find answer to the query raised.
Edited on:
01-May-2017 12:28
Edited by:
srivastava@unfpa.org
28th April 2017
QUERY BOARD : End Line Evaluation AAG intervention in Rajasthan and Odisha
Answers to the queries raised by probable bidders
Q1. As per RFP, “Other respondents to be covered include- parents, community members including opinion leaders and PRI representatives, and frontline workers in 25 percent of the PSUs.” What would be the sample size of above respondents? Do the research agency has to propose the sample size?
A1- It would be good that agency proposes appropriate number of such respondents in their technical proposal.
Edited on:
28-Apr-2017 13:16
Edited by:
srivastava@unfpa.org
27th April 2017
QUERY BOARD : End Line Evaluation AAG intervention in Rajasthan and Odisha
Answers to the queries raised by probable bidders
Q1 The baseline surveys in the intervention and control blocks have already been conducted. Are the reports of these studies available? Can you please share or provide link if available. This will help in preparation of the Tech Proposal for the End Line Evaluation.
A1 The report of the baseline surveys in case and control areas are available and will be shared with the agency which will be selected to undertake the study through this bidding process. For preparation of the technical proposal, please refer to selection criteria and methodological part detailed out in the TOR.
Q2 It is stated in the RFP that a baseline of the project and control villages is available.
Q2a Was the baseline conducted in all the project villages?
Ans 2a : The baseline was conducted in a representative sample of villages.
Q2b Were all the villages of the given project blocks covered under the project?
Ans 2b: All the villages in the blocks were covered under the project implementation.
Q3 Table 1 of the RFP states the distribution of the sample size.
3a. For Rajasthan, the minimum sample size and the finite population adjusted sample size is the same. Further, as per the calculations, the adjusted sample size should be 387 (as also mentioned in the text of the RFP). Thus, the sample size in Rajasthan and the total sample size for the study will increase with this change. Please can a clarification be shared towards this.
Ans 3a: The adjusted sample size takes into account finite population corrections and no response, and with such factors the final sample size comes out to be equal to the minimum sample size. Please undertake the calculations of finite population correction and adjust for no response to check the final sample to be considered.
Q4 The RFP states that the survey will cover 22 Primary Sampling Unit (PSU) in each geographical domain and two age categories in Rajasthan and 16 PSUs in Odisha for each geographical domains and two age categories. Total of 98 PSUs across the 2 states.
Q4a When dividing the sample size in each region by 16 (number of adolescents to be interviewed in each age category), the number of PSUs to be selected is 23.25 per block in Rajasthan and 17 in Odisha. To arrive at the total samples in each block as per table 1 of RFP, we will need to either increase the sample size per category per PSU to 17 OR increase the total PSUs to 104 (70 in Rajasthan and 34 in Odisha). Kindly let us know of any revisions in the note.
Ans 4a - We would like to go with the number of primary sampling units suggested in the TOR.
Q4b It is understood from the RFP that in each PSU approximately 32 adolescent girls will be interviewed (16 from 10-15 age category and 16 from 15-19 age category). Kindly confirm.
Ans4b - Please refer to the details provided in the methodology section of the TOR.
Q5. The end-line survey seeks interviews with parents, community members, frontline workers in 25 percent of the PSUs.
Q5a. Is it envisaged that the interviews are quantitative in nature or qualitative in nature? Their type will have an effect on the nature of tools, field work, sample selection, analysis and also the financial budget. This information can help us prepare a stronger methodology and a more detailed budget.
Ans 5a. The intend to have semi-structured in-depth interview as is done in qualitative studies.
Q5b. Does 25% of the PSUs include both project and control blocks?
Ans5b: As mentioned in the TOR, it includes all PSUs.
Q6 Is a pilot of the tools required at the endline survey stage, given that the tool has been used at the baseline?
Ans Q6 No major pilot testing is envisaged, however, there might be some additional questions regarding the project, which may need to be piloted.
Q7 We would like to propose a Computer Aided Personal Interviews (CAPI) based data collection using Tablets. Is UNFPA looking at use of paper based data collection with data entry only or can we propose an alternate method of data collection? This will therefore have implications on the budget.
Ans 7- UNFPA has no preference for either of the approach of data capturing. It is upto the agency to propose given the competitive nature of the bidding process.
Q8 The price schedule form (Annex 6) differs from the cost format provided in the RFP. Please can you clarify which format is to be used?
Ans 8. The format given in the RFP is to be used for the financial proposal, pls ignore the format given in Annex 6
Edited on:
28-Apr-2017 07:21
Edited by:
srivastava@unfpa.org