In Geislingen, Waldburg, and Stuttgart-Rot, very different new mobility solutions were implemented (see Step 6A). The project team examined how the development and implementation of the solutions took place. This is called process evaluation. In addition to this, we conducted an impact evaluation to assess the effects of the new mobility solutions. This approach is based on the idea that in community-driven mobility projects, four stages can be distinguished: Inputs, Outputs, Outcomes, and Impact.

Two central questions were important to us:

To answer these questions, the project team identified different themes and indicators for which information was collected. For the process, the following themes were considered: involvement, motivation, self-efficacy, social interaction, engagement, and external resources of the volunteers. This helped us better understand the people who were engaged in the neighborhoods for the MobiQ projects. The impact indicators were: greenhouse gas emissions, vehicle fleet, traffic reduction and avoidance, public services, acceptance, affordability, financial viability, and sustainability.

To familiarize ourselves with the MobiQ process and the people involved, we conducted a series of interviews. In advance, we prepared a set of questions to guide the interviews. We documented the conversations as audio recordings and then transcribed them. To capture the impacts of the mobility projects in MobiQ, we used various methods. Residents from the neighborhoods, for example, could provide feedback online on how they were using the new offerings.

Combined with additional information, this provided an overview of the projects’ impact, as illustrated here by the „Lastenrad-Verleih“ (Cargo Bike Rental) mobility project in Waldburg:

I didn’t know there was so much space on the street!“

With MobiQ, we were able to learn as we went along because we conducted the process and impact evaluations simultaneously.

With MobiQ, we were able to learn as we went along because we conducted the process and impact evaluations simultaneously.

It was found that the cargo bike contributes to reducing greenhouse gas emissions, avoiding car trips, and managing daily trips within the locality. The cargo bike is popular, but its acquisition is expensive. Maintenance, insurance, and the booking platform also incur costs. The „Pendla“ platform, however, saves greenhouse gas emissions with low costs or even monetary savings. It also became clear that the number of carpool rides documented on the platform did not increase as much as the number of users. From this, we concluded that the service needs to be regularly brought to people’s attention through advertising.

The shopping shuttle has become an almost indispensable part of daily life for a largely immobile population group. However, a better utilization rate or a different vehicle drive system could improve the ecological balance.

By investigating the social structures and processes surrounding these services, we were able to understand what is necessary to sustain mobility services at the three locations in the long term. From the survey results, we also gathered additional ideas that could be implemented in the future.

For evaluating processes, interviews are a good option. Here’s how you can proceed:

Surveys with questionnaires are ideal for assessing the effects. You can proceed as follows:

• Open-ended questions (W-questions) – when respondents are asked to provide a detailed answer, e.g., „What suggestions for improvement do you have for the cargo bike rental?“
• Closed questions – when an overview is helpful, but only one answer is expected, e.g., „Which vehicle would you have used if the cargo bike were not available?“ a) Car, b) Public transport, c) Bicycle, d) On foot, e) Other means of transport, f) Without the cargo bike, I wouldn’t have made the trip, g) Don’t know.
• List questions – when an overview is helpful, but multiple answers are possible, e.g., „Which vehicles are available in your household?“ a) Car, b) Bicycle, c) Motorcycle, d) Scooter, e) Other means of transport, f) Don’t know.
• Ranking questions – when the order of importance is important, e.g., „Rank the following cargo bike features in descending order of importance. Assign them numbers 1–3.“ Electric drive (1), Child seat (2), Rain cover (3).
• Rating questions – when something needs to be rated, e.g., „How did you like your last ride with the cargo bike?“ Good, rather good, rather bad, bad.
• Input questions – when a numerical value is needed, e.g., „How many kilometers did you travel with the cargo bike last time?“ ___ km

Cities and municipalities, institutions, and associations often have more staff and financial resources than private initiatives. This creates new opportunities for evaluating projects. The evaluation of processes and impacts can be conducted internally or outsourced, depending on the goal and budget. Regardless of which solution a municipality or institution chooses, it can be helpful to go through the following checklist in advance.