Feature/admin workflow surveys page

• Adds status fields to surveys and responses
• Creates a survey admin page, on which you can set the survey status and create a new survey (url /survey/admin/surveys)
• Slightly different way of opening the survey in the frontend, both the year and nren are url params now
• Add a migration to add the 2022 survey model to the database; dont read it from file anymore
• Adds a dump_survey_json command to assist with making edits to the survey model
• Fixes some small bugs in the conversion mapping
• Use the built-in surveyjs templating for the years and use a better way of validating urls
• Fix a bug that made the validation of the sum of percentages crash on 0.x numbers

Note that all existing surveys and responses are removed by one of the migrations. After running the migrations you will have to run conversion

compendium_v2/conversion/conversion.py

@@ -19,7 +19,7 @@ from compendium_v2.db import db
 from compendium_v2.config import load
 from compendium_v2.survey_db import model as survey_model
 from compendium_v2.db.model import NREN
-from compendium_v2.db.survey_model import Survey, SurveyResponse
+from compendium_v2.db.survey_model import Survey, SurveyResponse, ResponseStatus
 
 from compendium_v2.conversion import mapping
 
@@ -56,6 +56,9 @@ def convert_answers(answers):
                     mapped_answer.append(mapping.VALUE_TO_CODE_MAPPING[id][entry])
                 answer = mapped_answer
 
+        if id == 16504:
+            answer = '\n'.join(answer)
+
         # code to convert my description in the mapping to a json structure
         question_names = question_name.split(":")
         subdict = data
@@ -116,21 +119,19 @@ def _cli(app):
             SurveyResponse.survey_year == 2022
         ))
 
-        db.session.execute(delete(Survey).where(
-            Survey.year == 2022
-        ))
-
-        survey = Survey(year=2022, survey={})
-        db.session.add(survey)
+        survey = db.session.scalar(select(Survey).where(Survey.year == 2022))
 
         for nren, answers in nren_surveys.items():
             survey_dict = convert_answers(answers)
+            survey_dict["page"] = 0
+            survey_dict["verification_status"] = {}
             response = SurveyResponse(
                 nren=nren,
                 nren_id=nren.id,
                 survey_year=2022,
                 survey=survey,
-                answers=survey_dict
+                answers=survey_dict,
+                status=ResponseStatus.checked
             )
             db.session.add(response)