Central European Business Review 2021, 10(4):1-31 | DOI: 10.18267/j.cebr.266

Evaluation of the Effects of the Graduate Practice in Slovakia: Comparison of Results of Counterfactual Methods

Lucia ©vábová ORCID...1, Katarína Kramárová ORCID...2, Marek Ďurica ORCID...3
1 Department of Economics, Faculty of Operation and Economics of Transport and Communications, University of Zilina, Zilina, Slovakia, lucia.svabova@fpedas.uniza.sk
2 Department of Economics, Faculty of Operation and Economics of Transport and Communications, University of Zilina, Zilina, Slovakia, katarina.kramarova@fpedas.uniza.sk
3 Department of Quantitative Methods and Economic Informatics, Faculty of Operation and Economics of Transport and Communications, University of Zilina, Zilina, Slovakia, marek.durica@fpedas.uniza.sk

Graduate Practice is in Slovakia one of the measures of active labour market policy aimed at decreasing the unemployment rate of young graduates. It is one of the most frequently used interventions by young jobseekers under the age of 26; similar measures are used in other European Union (EU) member states. The specific objective of this intervention is to provide young jobseekers to gain the first contact with the labour market, first work experience and work habits that may be attractive to potential employers. The intervention is financed from the European Social Fund (within the Operational Program – Human Resources and the priority axis – Youth Employment Initiative) and the state budget. This fact requires ad 1) to evaluate the eligibility of drawing these resources and ad 2) to evaluate the effectiveness of the use of resources in terms of employability and sustainability of participants of the intervention in the labour market, the second of which is the primary objective of this study. The European Commission has increasingly required the member states of the EU to carry out impact evaluations of funded interventions and to develop evidence-based policies that will implement the results of such evaluations. The aim of this study is, therefore, to evaluate and review the effects of the Graduate Practice on the employability of young jobseekers in conditions of Slovakia. This evaluation is carried out using a counterfactual approach by comparing the results of treated and non-treated individuals by applying the three most used methods: regression adjustment, instrumental variable, and propensity score matching method. The results indicate significant effects of the Graduate Practice on the employability of young jobseekers and their sustainability in employment. The results of the evaluation are valuable mainly for policymakers, i.e. in setting the rules of the intervention and its eligibility to make the measure more effective or potentially in preparing other measures aimed at youth unemployment.
Implications for Central European audience: The findings of the evaluation may inspire policymakers in other countries than Slovakia to introduce similar or new programs for the youth unemployed. The results of this study may also be used for an international comparison of the effectiveness of interventions if a similar program for youth unemployed operates in another country, which may be appropriate mainly from the point of view of being a program(s) co-financed by the European Social Fund.

Keywords: counterfactual evaluation; Graduate practice; active labour market policy; intervention
JEL classification: C54, J08, J64

Received: July 2, 2020; Revised: November 2, 2020; Accepted: November 9, 2020; Prepublished online: May 25, 2021; Published: September 20, 2021  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
©vábová, L., Kramárová, K., & Ďurica, M. (2021). Evaluation of the Effects of the Graduate Practice in Slovakia: Comparison of Results of Counterfactual Methods. Central European Business Review, 10(4), 1-31. doi: 10.18267/j.cebr.266
Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. Agocs, P., & Agocs, S. (1994). Youth in post-communist Hungary. Society, 31(3), 76-81. https://doi.org/10.1007/BF02693235 Go to original source...
    2. Angrist, J. D., & Pischke, J.-S. (2009). Mostly Harmless Econometrics: An Empiricist's Companion (1 edition). Princeton University Press. Go to original source...
    3. Arco-Tirado, J. L., Fernández-Martín, F., Ramos-García, A. M., Littvay, L., Villoria, J., & Naranjo, J. A. (2018). A counterfactual impact evaluation of a bilingual program on students' grade point average at a spanish university. Evaluation and Program Planning, 68, 81-89. https://doi.org/10.1016/j.evalprogplan.2018.02.013 Go to original source...
    4. Barcakova, M., & Janas, K. (2019). Youth Unemployment in Slovakia and in Slovenia. Izzivi Prihodnosti / Challenges of the Future, 4(2), 98-105.
    5. Barosova, M., & Keselova, D. (2012). Application of active labor market measures in the context of European Union application practice(Final report VU n. 2159). Ministry of Labor, Social Affairs and Family of the Slovak Republic, Labor Market Policy Department. https://www.ceit.sk/IVPR/images/IVPR/vyskum/2012/Barosova/2159_kolektiv.pdf
    6. Bell, D. N. F., & Blanchflower, D. G. (2011). Young people and the Great Recession. Oxford Review of Economic Policy, 27(2), 241-267. https://doi.org/10.1093/oxrep/grr011 Go to original source...
    7. Borik, V., & Caban, M. (2013). Pilot impact evaluation of selected active labor market policy measures [Pilotné hodnotenie dopadov vybraných opatrení aktívnej politiky trhu práce]. The Ministry of Labour, Social Affairs and Family of the Slovak Republic.
    8. Borik, V., Durica, M., Molnarova, M., & Svabova, L. (2015). The net effects of graduate work experience and the promotion of self-employment: Technical report. The Ministry of Labour, Social Affairs and Family of the Slovak Republic.
    9. Burda, M. C., & Lubyova, M. (1995). The Impact of Active Labour Market Policies: A Closer Look at the Czech and Slovak Republics. Centre for Economic Policy Research. https://cepr.org/active/publications/discussion_papers/dp.php?dpno=1102#
    10. Caliendo, M., Künn, S., & Mahlstedt, R. (2017). The return to labor market mobility: An evaluation of relocation assistance for the unemployed. Journal of Public Economics, 148, 136-151. https://doi.org/10.1016/j.jpubeco.2017.02.008 Go to original source...
    11. Caliendo, M., & Schmidl, R. (2016). Youth unemployment and active labor market policies in Europe. IZA Journal of Labor Policy, 5(1), 1. https://doi.org/10.1186/s40173-016-0057-x Go to original source...
    12. Cappellini, E., Maitino, M., Patacchini, V., & Sciclone, N. (2019). Are traineeships stepping-stones for youth working careers in Italy? International Journal of Manpower, 40(8), 1389-1410. https://doi.org/10.1108/IJM-03-2018-0099 Go to original source...
    13. Cefalo, R., Scandurra, R., & Kazepov, Y. (2020). Youth Labor Market Integration in European Regions. Sustainability, 12(9), 3813. https://doi.org/10.3390/su12093813 Go to original source...
    14. Cerulli, G. (2015). Econometric Evaluation of Socio-Economic Programs: Theory and Applications. Springer-Verlag. https://doi.org/10.1007/978-3-662-46405-2 Go to original source...
    15. CRIE. (2014). Handout for the training workshop on counterfactual impact evaluation.
    16. Donato, L., Migliore, M. C., & Poy, S. (2018). Employment Effects of Vocational Training: An Evaluation Using Propensity Score Matching. Politica Economica, 3, 273-296.
    17. Dunsch, S. (2016). Okun's Law and Youth Unemployment in Germany and Poland. International Journal of Management and Economics, 49(1), 34-57. https://doi.org/10.1515/ijme-2016-0003 Go to original source...
    18. Dvoulety, O. (2017). Does the Self-employment Policy Reduce Unemployment and Increase Employment? Empirical Evidence from the Czech Regions. Central European Journal of Public Policy, 11(2), 11-22. https://doi.org/10.1515/cejpp-2016-0032 Go to original source...
    19. Dvoulety, O., & Lukes, M. (2016). Review of Empirical Studies on Self-Employment out of Unemployment: Do Self-Employment Policies Make a Positive Impact? Nternational Review of Entrepreneurship, 14(3), 361-376.
    20. Elia, L., Santangelo, G., & Schnepf, S. V. (2016). Synthesis report on the call 'Pilot projects to carry out ESF related counterfactual impact evaluations'. Publications Office of the European Union. http://op.europa.eu/en/publication-detail/-/publication/3d8a3354-084d-11e6-b713-01aa75ed71a1/language-en
    21. European Parliament. (2020, 15th July). Covid-19: How the EU fights youth unemployment | News | European Parliament. https://www.europarl.europa.eu/news/en/headlines/society/20200709STO83004/covid-19-how-the-eu-fights-youth-unemployment
    22. Eurostat. (2020). Young people aged 15-24 neither in employment nor in education and training (NEET), by sex-Quarterly data. http://appsso.eurostat.ec.europa.eu/nui/show.do?lang=en&dataset=lfsi_neet_q
    23. Frondel, M., & Schmidt, C. M. (2005). Evaluating environmental programs: The perspective of modern evaluation research. Ecological Economics, 55(4), 515-526. https://doi.org/10.1016/j.ecolecon.2004.12.013 Go to original source...
    24. Golias, P. (2014). How to decrease unemployment in Slovakia. Joint seminar of the European Commission Representation in Slovakia and the institute INEKO "How to reduce unemployment in Slovakia," Bratislava, Slovakia.
    25. Grandtnerova, L. (2014). Promoting employment for young people [Podpora zamestnanosti pre mladých µudí]. Ministry of Labor, Social Affairs and Family of the Slovak Republic, Labor Section, Institute for Work and Family Research. https://www.ceit.sk/IVPR/images/IVPR/NSZ/nsz_10.pdf
    26. Gregova, E., & Dengov, V. (2015). The Practical Economic Policy in Transition Economies of V4 Countries at the Present Stage of Globalization. Globalisation and Its Socio-Economic Consequences: 15th International Scientific Conference: Proceedings, 150-156. https://pureportal.spbu.ru/en/publications/the-practical-economic-policy-in-transition-economiesof-v4-countr
    27. Gripaios, P., Bishop, P., Hart, T., & McVittie, E. (2008). Analysing the Impact of Objective 1 Funding in Europe: A Review: Environment and Planning C: Government and Policy, 26(3), 499-524. https://doi.org/10.1068/c64m Go to original source...
    28. Harvan, P. (2011). Evaluation of efficiency and effectiveness of active labor market policy expenditures in Slovakia [Hodnotenie efektívnosti a účinnosti výdavkov na aktívne politiky trhu práce na Slovensku]. Ministry of Finance of Slovak Republic.
    29. Imbens, G. W., & Rubin, D. B. (2015). Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press. https://doi.org/10.1017/CBO9781139025751 Go to original source...
    30. Janicko, P. (2012). Youth Employment in the Czech Republic. Friedrich-Ebert-Stiftung. https://library.fes.de/pdf-files/id/09471.pdf
    31. Karasova, K. (2013). Active labor market measures and their impact on the dynamics of unemployment in the Slovak Republic [Dissertation thesis]. University of Economics in Bratislava, Faculty of Economic Informatics, Department of Statistics.
    32. Knox, V., Hill, C. J., & Berlin, G. (2018). Can Evidence-Based Policy Ameliorate the Nation's Social Problems? The ANNALS of the American Academy of Political and Social Science, 678(1), 166-179. https://doi.org/10.1177/0002716218769844 Go to original source...
    33. Kostolna, Z. (2010). Unemployment of school leavers and approaches to its solution in EU member states during the global economic crisis [Nezamestnanos» absolventov ąkôl a prístupy k jej rieąeniu v členských ątátoch EU v období globálnej ekonomickej krízy] (Final Report VÚ n. 2146). Ministry of Labor, Social Affairs and Family of the Slovak Republic, Labor Section, Institute for Work and Family Research. https://www.ceit.sk/IVPR/images/IVPR/vyskum/2010/Kostolna/VU_2146_Kostolna.pdf
    34. Koszela, A. (2020). The influence of staff turnover on work motivation and job performance of employees in IT sector - the results of empirical research. Forum Scientiae Oeconomia, 8(1), 29-48. https://doi.org/10.23762/FSO_VOL8_NO1_3 Go to original source...
    35. KPMG. (2015a). Analysis of youth unemployment in the Slovak Republic [Analýza nezamestnanosti mladých µudí v SR] (p. 88) [Final report]. Slovak Government Office. file:///C:/Users/lucix/Downloads/Anal%C3%BDza%20nezamestnanosti%20mlad%C3%BDch%20%C4%BEud%C3%AD%20v%20SR%20-%20Z%C3%A1vere%C4%8Dn%C3%A1%20spr%C3%A1va.pdf
    36. KPMG. (2015b). Counterfactual Impact Evaluation Methods. https://www.partnerskadohoda.gov.sk/data/files/77_epublikaciaeu.pdf
    37. Kurekova Mytna, L., Salner, A., & Farenzenova, M. (2013). Implementácia aktivačných prác na Slovensku: Hodnotenie a odporúčania pre verejnú politiku, Zhrnutie záverečnej správy. Slovak Governance Institute Bratislava. http://stary-web.governance.sk/assets/files/publikacie/AKTIVACNE_PRACE_SGI_SK-_ZHRNUTIE.pdf
    38. Lelkes, G., Kmet, P., Ondrus, B., Pribelsky, V., & Vaclavova, M. (2019). NEET in Slovakia-With whom and how [NEET v SR - s kým a ako] (National Project Support for the Quality of Social Dialogue, p. 80). https://www.ia.gov.sk/data/files/np_PKSD/Analyzy/Stat/NEET_SR_-_s_kym_a_ako.pdf
    39. Lenihan, H., & Hart, M. (2016). The Use of Counterfactual Scenarios as a Means to Assess Policy Deadweight: An Irish Case Study: Environment and Planning C: Government and Policy, 22(6), 817-839. https://doi.org/10.1068/c0413 Go to original source...
    40. Lubyova, M. (1997). Aktívna politika trhu práce v Slovenskej republike. Centrum pre hospodársky rozvoj, s podporou Ford Foundation a zastúpenia nadácie F. Eberta.
    41. Maguire, S., Cockx, B., Dolado, J. J., Felgueroso, F., Jansen, M., Styczyńska, I., Kelly, E., McGuinness, S., Eichhorst, W., Hinte, H., & Rinne, U. (2013). Youth unemployment. Intereconomics, 48(4), 196-235. https://doi.org/10.1007/s10272-013-0464-9 Go to original source...
    42. Marginean, S. (2014). Youth Unemployment in Romania: Post-crisis Challenges. Procedia Economics and Finance, 16, 613-620. https://doi.org/10.1016/S2212-5671(14)00848-X Go to original source...
    43. Mikiashvili, N., & Lobzhanidze, N. (2017). Green innovations and economic policy in small economies. Forum Scientiae Oeconomia, 5(2), 29-40. https://doi.org/10.23762/fso_vol5no2_17_3 Go to original source...
    44. Mueller, C. E., & Gaus, H. (2015). Assessing the performance of the "Counterfactual as Self-Estimated by Program Participants": Results From a Randomized Controlled Trial. American Journal of Evaluation, 36(1), 7-24. https://doi.org/10.1177/1098214014538487 Go to original source...
    45. Noelke, C., & Horn, D. (2014). Social Transformation and the Transition from Vocational Education to Work in Hungary: A Differences-in-differences Approach. European Sociological Review, 30(4), 431-443. https://doi.org/10.1093/esr/jcu048 Go to original source...
    46. OECD. (2010). OECD Employment Outlook 2010: Moving beyond the Jobs Crisis. OECD. https://doi.org/10.1787/empl_outlook-2010-en Go to original source...
    47. OECD. (2020a). Unemployment-Unemployment rate by age group-OECD Data. TheOECD. http://data.oecd.org/unemp/unemployment-rate-by-age-group.htm
    48. OECD. (2020b). Unemployment-Youth unemployment rate-OECD Data. TheOECD. http://data.oecd.org/unemp/youth-unemployment-rate.htm
    49. Patache, L. (2015). TRENDS IN YOUTH EMPLOYMENT: ROMANIA CASE OF STUDY. Ecoforum Journal, 4(SI 1), 147-152.
    50. Pelucha, M., Kveton, V., & Potluka, O. (2019). Using mixed method approach in measuring effects of training in firms: Case study of the European Social Fund support. Evaluation and Program Planning, 73, 146-155. https://doi.org/10.1016/j.evalprogplan.2018.12.008 Go to original source...
    51. Polakowski, M. (2012). Youth Unemployment in Poland. Friedrich-Ebert-Stiftung. http://library.fes.de/pdf-files/id/09477.pdf
    52. Popescu, M. E., & Roman, M. (2018). Vocational training and employability: Evaluation evidence from Romania. Evaluation and Program Planning, 67(C), 38-46. Go to original source...
    53. Potluka, O., Bruha, J., Spacek, M., & Vrbova, L. (2016). Counterfactual Impact Evaluation on EU Cohesion Policy Interventions in Training in Companies. Ekonomicky Casopis, 64(6), 575-595.
    54. Quintini, G., Martin, J. P., & Martin, S. (2007). The Changing Nature of the School-to-Work Transition Process in OECD Countries. SSRN Electronic Journal, IZA DP No. 2582. https://doi.org/10.2139/ssrn.1884070 Go to original source...
    55. Ragazzi, E. (2014). Effectiveness Evaluation of Training Programmes for Disadvantaged Targets. Procedia - Social and Behavioral Sciences, 141, 1239-1243. https://doi.org/10.1016/j.sbspro.2014.05.213 Go to original source...
    56. Research Institute of Labor and Social Affairs of the Czech Republic. (2003). Problems of labor market and employment policy [Problémy trhu práce a politiky zaměstnanosti] [Summary report from a research study carried out under the "Modern Society" program]. Ministry of Labor and Social Affairs of the Czech Republic. https://www.mpsv.cz/documents/20142/848077/zprava.pdf/1d796cfb-d654-4d97-0226-d410d44723a5
    57. Sianesi, B. (2004). An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s. The Review of Economics and Statistics, 86(1), 133-155. https://doi.org/10.1162/003465304323023723 Go to original source...
    58. Stefanik, M. (2014). Estimating treatment effects of a training programme in Slovakia using propensity score matching. Ekonomický Časopis (Journal of Economics), 62(6), 631-645.
    59. Stefanik, M., Karasova, K., & Studena, I. (2020). Can supporting workplace insertions of unemployed recent graduates improve their long-term employability? Empirica, 47(2), 245-265. https://doi.org/10.1007/s10663-018-9413-y Go to original source...
    60. Stefanik, M., Lubyova, M., Dovalova, G., & Karasova, K. (2014a). Analysis of the effects of active labor market policy measures. The Ministry of Labour, Social Affairs and Family of the Slovak Republic. https://www.ia.gov.sk/data/files/np_csd_I/KOZ/Analyza_ucinkov_nastrojov_aktivnej_politiky_trhu_prace_finalna_verzia.pdf
    61. Stefanik, M., Lubyova, M., Dovalova, G., & Karasova, K. (2014b). Analysis of the effects of active labor market policy measures [Analýza účinkov nástrojov aktívnej politiky trhu práce]. The Ministry of Labour, Social Affairs and Family of the Slovak Republic. https://www.ia.gov.sk/data/files/np_csd_I/KOZ/Analyza_ucinkov_nastrojov_aktivnej_politiky_trhu_prace_finalna_verzia.pdf
    62. Styczynska, I. (2020). In-depth analysis on "Social impact investment: Best practices and recommendations for the next generation." http://case-research.eu/en/in-depth-analysis-on-social-impact-investment-best-practices-and-recommendations-for-the-next-generation-101465
    63. Svabova, L., & Durica, M. (2018). Who were the jobseekers treated by the graduate practice intervention? A closer view on the beneficiaries of the intervention. Proceedings of the Faculty of Economics of Matej Bel University in Banska Bystrica. Volume I., 614-624.
    64. Trivellato, U. (2011). Fifteen years of labour market regulations and policies in Italy: What have we learned from their evaluation? Statistica, 71(2), 167-187. https://doi.org/10.6092/issn.1973-2201/3610 Go to original source...
    65. Walther, A., Zentner, M., Cicognani, E., Hansen, B. J., Kühn, R., Szelenyi, Z., & Williamson, H. (2008). Youth policy in Hungary: Conclusions of the Council of Europe international review team. Council of Europe Publ.
    66. White, H., & Sabarwal, S. (2014). Quasi-Experimental Design and Methods: Methodological Briefs - Impact Evaluation No. 8. https://econpapers.repec.org/paper/ucfmetbri/innpub753.htm

    This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY NC ND 4.0), which permits non-comercial use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


    Return to the content