# Linguapop > Linguapop is an adaptive, CEFR-aligned online language placement test for schools and organizations. This is its documentation. This file contains all documentation content in a single document following the llmstxt.org standard. ## Linguapop documentation Welcome to **[Linguapop](https://www.linguapop.eu)**, your ultimate solution for delivering placement tests! In the following documentation, you will find all necessary information to get started and use Linguapop to its fullest. ### Getting Started In order to access Linguapop you will need to [register an account](https://app.linguapop.eu/registration). Once registered, you can log in to your [Dashboard](https://www.linguapop.eu/docs/dashboard). At any time, you can customize and preview the look of your placement tests and invitation emails from the [Customization page](https://www.linguapop.eu/docs/customization). Before you can send out placement tests, you will need to [set up your billing information](https://www.linguapop.eu/docs/billing). ### Registration When registering, keep in mind that you are registering an account **for your school or organization**. You will be creating: * An organization profile * Your own user account within the organization Later on, you will be able to [manage additional users](https://www.linguapop.eu/docs/organization-users) for your organization. You can also register as an individual - just put your own name under the **Organization name** field in the registration form. ### Support As it takes us time to respond to your query, always try to find your answer within the documentation provided here. In the top-right corner of the documentation website you will find a search feature which you can use to search by keywords. Suggestions should pop out as soon as you start typing. If you can't find what you're looking for, support is available to all Linguapop users via e-mail: [support@linguapop.eu](mailto:support@linguapop.eu) --- ## Dashboard Your Dashboard gives you an overview of your placement tests, and allows you to send invitations to candidates. If you want to test groups of candidates in bulk, we recommend looking into [Multi-use links](https://www.linguapop.eu/docs/multi-use-links) or [Integrations](https://www.linguapop.eu/docs/integrations). ### Send placement tests You have multiple panels for sending placement tests from the Dashboard. The following sections describe each panel: #### Email Use this panel to send placement test invitations to your candidates via email. For each candidate, you enter their **email** and select the language you want to test them in. Clicking the **Add** button adds the candidate to a list of invitations. You can add as many candidates as you want by repeating this process. If you wrongly entered a candidate, you can remove them from the list by clicking the small **X** to the right of their email address. You can optionally select whether you want to test reading and/or listening skills at the end of each placement test. Once you have entered all your candidates (or even a single candidate!) you can send the invitations by clicking on the **Send invites** button. #### WhatsApp Use this panel to send placement test invitations to your candidates using WhatsApp. Once you fill out the candidate's **phone number** and select the language you want to test them in, you can click **Send** to create an invitation. A new tab will automatically open which will do one of the following, depending on the device you're using: - If you are on a **desktop PC** or a **Mac**, a tab to **WhatsApp Web** will be opened. Inside, you will get the option to send a pre-filled message to the phone number of your candidate. - If you are on a **mobile device** and have **WhatsApp** or **WhatsApp Business** installed, it will open. Inside, you will get an opened chat with your candidate, and a pre-filled message. The pre-filled message will contain your text from [Customization](https://www.linguapop.eu/docs/customization#whatsapp) and a direct link to that candidate's invitation. If your browser prevents pop-ups, you can still send your invitation message to your candidate by clicking on the **Click here** link in the success message: We advise that you allow pop-ups for the Linguapop app inside your browser settings for convenience when using WhatsApp and WhatsApp Business. #### Share Link Use this panel when you want to create a shareable invitation link without an email address or WhatsApp phone number. Once you fill out the candidate's **name** and select the language you want to test them in, you can click **Create** to create an invitation. A unique invitation link will appear below the candidate's name, with a **Copy** button next to it, and a **Share** button on devices that support native sharing. Clicking on the **Copy** button will copy the invitation link. Clicking on the **Share** button will open your device's native share dialog, which will allow you to share the invitation link through any application installed on your device. #### Kiosk This panel is only available if you have a Kiosk set up in your organization's [Customization](https://www.linguapop.eu/docs/customization#kiosk) screen. Use this panel when you want to create a kiosk code usable through your unique kiosk link. Once you fill out the candidate's **name** and select the language you want to test them in, you can click **Create** to create an invitation. A unique kiosk code will appear below the candidate's name, with a **Copy** button next to it. Clicking on the **Copy** button will copy the kiosk code. ### Weekly stats Here, you have 3 small panels giving you total numbers for the last 7 days for: - Open invitations - The total number of invitations sent in the last 7 days - Placement tests in progress - The total number of placement tests that have been started, but are not completed in the last 7 days - Completed placement tests - The total number of completed placement tests in the last 7 days Under these panels, you will find a chart detailing these numbers across the last 7 days. --- ## Invitations Invitations are used to start [placement tests](https://www.linguapop.eu/docs/placement-tests). Once you invite a candidate to take a placement test via the [Dashboard](https://www.linguapop.eu/docs/dashboard), they receive an email with a link to start the placement test, and an invitation is created. The invitation keeps track of the candidate's email address, and links to a placement test once a placement test has been started. Only one placement test can be created from one invitation. In the Invitations sidebar menu, you have three sections: ### All invitations This is a list of **all** invitations sent through Linguapop. Clicking on an invitation opens its details. ### Open invitations This is a list of invitations that **haven't yet been accepted**. This means that your candidate hasn't started the placement test from the link in their email. ### Stale invitations This is a list of invitations that **haven't been accepted in more than 7 days**. This means that your candidate hasn't started the placement test 7 days after you sent the invitation. You can use this to remind candidates to start their placement test. --- ## Placement tests Placement tests are the basis of Linguapop. They are used to assess the language skills of your candidates. The final result of every placement test is a candidate's **rating**, which translates to a **level** according to the CEFR. In the placement tests sidebar menu, you will find all placement tests under your organization. By clicking on a placement test, you will open the **placement test details screen**: If a placement test is completed, the candidate's rating and final CEFR Level will be displayed, alongside a graphical representation of their placement. The candidate's CEFR level is based on their **use-of-language** skills. If you also tested a candidate's reading and listening skills, a score (out of 5) will be displayed next to **Reading** and **Listening**. This is the number of questions your candidate answered correctly. Reading and Listening exercises are given to candidates based on their assessed CEFR level, and should be used to further determine where to place the candidate. You can use the graph together with the results of the Reading and Listening exercises to get a good picture of which level your candidate belongs to. ### All placement tests This is a list of **all placement tests ever started**. ### Placement tests in progress This is a list of placement tests that have been started, but are not completed. Candidates can leave a placement test and return to it at any time - all progress is saved. However, no intermediate results are shown - you can only see results once a placement test has been completed. ### Completed placement tests This is a list of all placement tests that have been successfully completed. Accessing any of the placement tests in this list will give you the results of that placement test. ### Stale placement tests This is a list of placement tests that are started (invitation accepted), but haven't been completed within 7 days. You can use this list to remind candidates to finish their placement test. --- ## Writing tasks Writing tasks allow you to assess your candidates' writing skills as part of their placement test. A writing task presents candidates with a topic and asks them to write an essay. You can then review and grade their work directly within Linguapop. ### Creating a writing task You can create a writing task by clicking the **Create** button in the top-right corner of the Writing tasks screen. You must configure the following: - **Task name** - An internal name used to identify the writing task. This is not shown to candidates. - **Active** - A toggle that determines whether this writing task can be presented to candidates. - **Language** - The language of the placement test this writing task applies to. - **CEFR Levels** - The levels for which this writing task is appropriate. Candidates whose Use of Language score falls within one of these levels may receive this task. - **Task explanation** - Guidelines shown to the candidate, typically including time and word count expectations. - **Topic** - The essay topic or prompt that will be presented to the candidate. You can optionally set a time limit for the writing task using the **Limit writing task to ___ minutes** toggle. Clicking **Save** creates the writing task. ### Managing writing tasks When you click on **Writing tasks** in the sidebar, you are taken to a list of all writing tasks. You can click on any writing task to open its details and edit it. Use the **Active** toggle to control which writing tasks are currently presented to candidates. Only active writing tasks can be assigned to candidates. ### When candidates receive a writing task A candidate will be presented with a writing task if all of the following conditions are met: - Writing tasks are enabled in the [Customization](https://www.linguapop.eu/docs/customization) screen - An active writing task exists for the tested language - The candidate's Use of Language score falls within one of the selected CEFR levels for an active writing task If multiple writing tasks match these criteria, one is selected at random. Writing tasks are presented after the candidate completes their Use of Language section, and optionally their Reading and Listening sections. ### Reviewing writing tasks Once a candidate completes their writing task, you can review it from within the placement test results. You can: - **Select and label text** - Highlight portions of the candidate's essay and add labels or comments - **Record notes** - Add notes about the candidate's writing - **Assign a level** - Grade the writing task with a CEFR level (A1-C2) and provide an explanation for your assessment ### Notifications When a candidate completes a placement test, you will receive two separate email notifications: 1. **Test completion email** - Sent when the candidate finishes their Use of Language, Reading and Listening sections 2. **Writing task completion email** - Sent when the candidate completes their writing task, with a direct link to review it :::info Writing tasks are not billed. A placement test is considered completed (and billable) once the candidate finishes their Use of Language, Reading and Listening sections. The writing task is an optional extra that does not affect billing. ::: --- ## Multi-use links Multi-use links allow you to create a shareable link that allows multiple students to self-serve their placement tests. Use cases: * Testing groups of students * Allowing agents to test candidates * Corporate testing Multi-use links can have a limited **number of uses** and an **expiration date**. ### Creating a multi-use link You can create a multi-use link by clicking the **Create** button in the top-right corner of the Multi-use links screen. You must enter a **name** for the multi-use link, and the **language** in which students will be tested. Optionally, you can set a **maximum number of uses** which determines how many times an invitation/placement test can be created from the given link. Once the link is used to create that number of invitations, no more can be created. You can always increase this limit, even if it is already reached. You can also optionally set an expiration date for your link using the **Link expires on** field. After that date, the link will no longer create invitations. You can always change this date. Lastly, you have an **Active** switch which determines whether invitations can be sent regardless of the multi-use link's maximum number of uses or expiration date. You can use this to immediately deactivate and reactivate a link at any time. Once you click **Save** you will be taken to the multi-use link's **management screen**. ### Managing a multi-use link Clicking on a link within the list in the **Multi-use links screen** will open a **management screen** from that link. In the top-right corner, you have an **Update** button which will allow you to change all of the link's properties, mentioned beforehand. In the main section, you will see two panels: The first panel displays the shareable multi-use link alongside two buttons: * **Copy** allows you to copy the link * **Share** opens the native share dialog of your device. This button is only available on devices that support a native share dialog (Windows, Android, iPhone) The second panel has two tabs: * **Placement tests** shows a list of all placement tests taken using invitations made through the multi-use link * **Invitations** shows a list of all invitations created using this multi-use link Both tabs behave like every other list in Linguapop. They can be searched, filtered and paged through. ### Using multi-use links When a candidate clicks on a multi-use link, they are prompted to enter their **name** and **email address**. Once the candidate enters this data, they can send themselves an invitation, and they can begin the placement test immediately. If a candidate leaves a test early, they can continue their placement test by accessing it through the invitation email that arrives in their inbox. --- ## Organization users When you register for Linguapop, you become the admin of your organization. As an **organization admin** you can add users to your organization. In the Organization users screen, you see a list of all users in your organization. ### Create a user You can add a user to your organization by clicking the **Create** button in the top-right of your Organization users screen. In the **Create organization user** screen, you will have to set: - the user's **email** - the user's **full name** - the user's **password** - whether the user is an **organization admin** Clicking on **Save** creates an account for your user and sends them an email with login details. The user will have to verify their email the first time they log in. :::warning An **Organization admin** can edit vital parts of your Linguapop organization! Make sure you only assign this to trusted members of your organization. ::: ### Update a user Clicking on a user in the Organization users list will open the **Update organization user** screen in which you can edit any one of your users. You can change their email, name, password and whether they are an organization admin. You can **leave the password field empty** - in that case the user's **password will not be changed**. Clicking on **Save** will update the user's details. --- ## Customization Linguapop offers you the possibility of **completely white-labeling** your placement tests using the Customization screen. This way, your candidates will see your brand in the emails Linguapop sends them, and when they are completing placement tests. You can customize every aspect of your placement test: ### Organization logo Here you can upload your organization's logo. This logo will be displayed instead of Linguapop's logo within emails and placement tests. You can upload a JPG, PNG or SVG image file. Your logo will be automatically resized to fit within a 240px by 80px box. Changing your logo and clicking **Save** at the bottom of the Customization screen will also change your company logo in the sidebar. :::tip It's best to use a logo image with a **transparent background**. PNG and SVG files support transparency. ::: ### Visual identity Within this section, you can choose the **primary color** of the test interface, together with the **rounding style of your buttons**. You can preview what the placement test will look like by clicking on the **Preview placement test** button. All of your tests, both new and old, will use the settings you define within the **Visual identity** section. :::tip **Align your placement test's visual identity to your brand colors and logo.** Are you using square buttons on your website? Use them in the placement tests too! ::: ### Placement test introduction Every placement test opens with an **introduction screen** that shows candidates a short list of bullet points explaining what to expect: whether the test is timed, roughly how long it takes, and that they'll get an assessment at the end. By default, Linguapop generates these points for you, based on your test configuration. By toggling **Customize placement test introduction bullet points**, you can **replace them with your own** wording, for example, to add your organization's instructions or translate the points into your candidates' language. Once enabled, you have two buttons: - **Add point** adds a new empty point to the list that you can type into. - **Use defaults** fills the list with Linguapop's standard points based on your current settings, giving you a starting point you can then edit. Type your text into each point's field, drag points by their handle to reorder them, and use the trash icon to remove a point. The order you set is the order candidates see. When customization is on, your points **fully replace** the default list and appear consistently across every way a candidate can reach a test: email invitations, kiosk, multi-use links, and integrations. You can **preview** the introduction screen exactly as a candidate would see it, including your custom points, by clicking on the **Preview test** button. :::tip Switching the toggle **off** restores Linguapop's default introduction, but **does not erase** your custom points. Turn it back on and your list is exactly as you left it. ::: ### Invitation email Within this section, you can define the content of the placement test invitation email Linguapop sends to your candidates. You can define the following: - **Organization name** - The name of your organization displayed in the title of the emails sent to candidates - **Title** - The title of the emails sent to your candidates - **First paragraph** - This paragraph is shown before the "Take placement test" button - **Text of the button** - The text of the "Take placement test" button - **Second paragraph** - This paragraph is shown after the "Take placement test" button You can **preview your customized email** by clicking on the **Preview email** button. #### Inserting the candidate's name You can also insert the candidate's name within the Title, First paragraph, Text of the button, and Second paragraph by entering **\{\{NAME\}\}** where you want the name to be inserted. For example, if your candidate's name is "John Doe", and your First paragraph is: ```txt Hello {{NAME}}, ... ``` the resulting text will be: ```txt Hello John Doe, ... ``` ### Additional skills tested Linguapop can optionally test candidate's **reading** and **listening** skills. Here you can define whether Linguapop will test reading and/or listening skills by default. This setting defines the default value of the **Test reading skills** and **Test listening skills** switches on the **Send placement test** section of your Dashboard. :::warning The **Additional skills tested** setting will only be applied to invitations you send after you set it. All previous invitations will keep the old settings - the ones they were sent with from the Dashboard. ::: ### Kiosk Linguapop supports an optional **Kiosk Mode**, which allows you to use a unique link in conjunction with a generated code that can be used to test candidates on-premise, with your devices. Toggling "Enable kiosk" will enable the Kiosk Mode, and you will need to enter a unique name for your kiosk, which will become part of the link used to access your kiosk. Enabling a kiosk will also present you with the unique link that will lead to your kiosk. :::tip **Use a short, lowercase name for your kiosk** For example, Linguapop uses the name `linguapop`, whereas a school called "My English School" could opt to use `myes` or `myenglishschool`. ::: :::tip **Create a bookmark for the kiosk within your on-premise devices** This way, candidates can quickly access a placement test on-premises, using a simple 6-digit code. No logins, emails, or messages required. ::: ### Time limit Linguapop can **optionally** limit the time a candidate can spend on the Use of Language part of the test. If a candidate leaves their test, their time spent on the test is saved, and the timer will continue counting down when they rejoin the test. :::warning While a time limit is supported, it is **not recommended**. Linguapop tests work best without a time limit, and it may impact the accuracy of the test. If you want to use a time limit, please set it to be larger than 40 minutes. ::: ### WhatsApp Here you can customize the behaviour of Linguapop's WhatsApp panel in the Dashboard. - **Default country dial code** sets which country's dial code is present in the phone number input by default. You can always change this inside the WhatsApp panel itself too. - **Invitation message** sets the message that precedes the invitation link that's sent via WhatsApp or WhatsApp Business Messenger. ### Notification email address When in use, this email address will receive emails notifying them when a candidate completes their placement test. Leaving it blank will simply not send email notifications. ### Reply-to email address When a candidate replies to an invitation or test email, their reply will be sent to this address. Leaving it blank means candidate replies will not reach your organization. :::tip **Set this to an inbox your team checks regularly.** This way, candidates' questions and replies always reach you. ::: ### Homepage When in use, this defines the URL to which candidates will be redirected if they decide to leave their placement test. Set this to your organization's website in order to take candidates back to your website if they decide to leave their placement test. --- ## Billing In the Billing screen, you can set up your billing information, add a payment method and start a Linguapop subscription. In order to **activate a subscription**, you will need to set both your **billing details** and **payment method**. :::warning **An active Linguapop subscription is required to administer placement tests** Without a subscription, candidates won't be able to access placement tests in progress, and you won't be able to send new invitations. *Don't worry - all completed placement tests and their results are still accessible, and all placement tests in progress are simply paused.* ::: ### Billing details Here you can see the information which will be present on your invoice. When first setting up your billing details, clicking the **customer portal** link will lead you to a Stripe-hosted page where you can set up your billing details. If you already have your billing details set up, the **Update billing details** button to the right will lead you to a Stripe-hosted page where you can update your billing details. Clicking on **Return to Warp Code d.o.o.** to the left in the Stripe-hosted page will lead you back to the Billing screen. Stripe collects all necessary information, including your company's VAT ID, if you have one. :::info Stripe automatically verifies your VAT ID, but this might take some time. If you see a *(pending)* text next to your VAT ID, that means it's still being verified. A text reading *(verified)* will be displayed next to a VAT ID which has successfully been verified. ::: ### Payment method Here you can see the payment method you set up for Linguapop to charge you at the end of each billing cycle. If you already have your payment method set up, clicking the **customer portal** link will lead you to a Stripe-hosted page where you can update your billing details and payment method. Clicking on the **Update payment method** button to the right will lead you to a Stripe-hosted page where you can update your payment method. Clicking on **Return to Warp Code d.o.o.** to the left in the Stripe-hosted page will lead you back to the Billing screen. ### Subscription Once you have set up your billing details and payment method, you can activate and cancel your subscription. #### Activating your subscription You can activate your subscription by clicking on the "Activate subscription" button at the bottom of this screen. Once active, your subscription will show the **amount due** and the **next invoice date**, which determines the end of your current billing cycle. A billing cycle ends (and a new one begins) exactly **one month** after you activate your subscription. The Linguapop subscription is **post-paid**, meaning that you pay at the end of each billing cycle for the usage in that billing cycle. **Usage** is calculated as the **number of completed placement tests** within a billing cycle. #### Cancelling your subscription You can cancel your Linguapop subscription at any time by clicking on the **Cancel subscription** button, and confirming your cancellation. If there is unpaid usage, your payment method will be immediately charged for the amount specified. --- ## Integrations Integrations are crucial for **integrating Linguapop with your own applications**, such as CRMs, LMSs, ERPs, etc. Integrations define API Keys which developers can use to communicate between your applications and Linguapop, allowing you to **send placement tests** and **receive placement test results** without ever having to leave your own management software. Point your developers to the [Linguapop API Documentation](https://www.linguapop.eu/docs/api) in order to integrate your software with Linguapop. Only **Organization admins** can add, archive and refresh the API Keys of integrations. :::tip **Your school already has its own website.** You can integrate your website with Linguapop to send placement tests to interested visitors. Once they finish their placement test, you can instantly fill your customer database with the results of their placement test. ::: ### Adding integrations You can add an integration by clicking the **+ Add** button in the top-right corner of the Integrations screen. You must enter a **Name** for your integration. You can use this name to identify the application or source you are integrating with. #### Advanced Zapier conditions You can set up custom language conditions that will be used by the `languageCode` property in the [Create Placement Test Invitation action](https://www.linguapop.eu/docs/zapier#create-placement-test-invitation-action). A condition consists of 2 fields: - Contains (case insensitive) - text - Language - selected from a dropdown When a Zap creates a new placement test invitation, Linguapop first checks if a language code from the Zap action Language dropdown is used. If you decide to use a custom value (e.g. a user selection field from your Google Forms), Linguapop will check your language conditions, looking whether the custom value contains any of the texts you defined in your language conditions. Linguapop will send a placement test with the first language it finds that fits your language conditions. Language conditions are not case-sensitive. Only a single placement test invitation will be sent for a given Zap. Example of a configuration using advanced Zapier conditions: ![Advanced Zapier conditions](https://www.linguapop.eu/docs/assets/images/advanced-zapier-conditions-de7e97eff22f9190749ee430fc142e7f.png) ### The integration API Key The **API Key** of an integration is the identifier for the integration when accessed by other software. You can provide your developers with the API Key of an integration in order for them to access the [Linguapop API](https://www.linguapop.eu/docs/api). :::warning **Keep your API keys secret!** Placement tests can be sent using integrations, which can incur costs. If you believe that your API Key has been compromised, you can **refresh** the API key, which generates a new API key for your integration. ::: ### Active integrations Only integrations in the **Active integrations** section will be accessible to other applications trying to connect via the [Linguapop API](https://www.linguapop.eu/docs/api). You can **edit** the integration's name by clicking on the **"..."** button to the right of your integration and then on **Edit** in the popup menu. You can **refresh** the API key for your integration by clicking on the **"..."** button to the right of your integration and then on **Refresh** in the popup menu. You can **archive** an integration by clicking on the **"..."** button to the right of your integration and then on **Archive** in the popup menu. :::warning **Refreshing an integration's API key will immediately invalidate the old API key.** This can cause your software to stop communicating with Linguapop until you update your API key in your software. ::: ### Archived integrations Archived integrations are **inactive** - their API keys won't be accepted by the [Linguapop API](https://www.linguapop.eu/docs/api). You should archive an integration if you no longer plan to use it. Archived integrations are hidden by default - clicking on the **Archived integrations** title will show all archived integrations. You can always **unarchive** an integration by clicking on the **"..."** button to the right of your integration and then on **Unarchive** in the popup menu. :::tip **Integrations should be per-application** If you use multiple apps to communicate with Linguapop, you should create an integration for each one. This way, if one application is compromised, you can archive/refresh only that one integration. ::: --- ## API The Linguapop API allows you to integrate Linguapop with your existing management software (CRM, LMS, etc.) or your website. With it, you can create and send placement test invitations, and fetch the list of available languages. ### Fetch available languages Send a **GET** request to: ```url https://app.linguapop.eu/api/actions/getLanguages ``` The endpoint returns a list of available languages: ```json title="Response" [ { "name": "English", "code": "eng" }, { "name": "Italian", "code": "ita" }, { "name": "Spanish", "code": "spa" }, { "name": "German", "code": "ger" }, { "name": "French", "code": "fra" } ] ``` You should use the `code` property of the language when sending invitations via the API. These codes aren't planned to change, however additional languages **are** planned. With this in mind, hard-coding for languages you offer is okay, as long as you keep up-to-date with new languages in case you want to offer placement tests in these languages. ### Send/create an invitation to a placement test You can create an invitation and send it to your candidate by sending a POST request to: ```url https://app.linguapop.eu/api/actions/sendInvitation ``` The request should have its `Content-Type` header set to `application/json`. Within the request body, you should include the following: ```json title="Request body" { "apiKey": "INTEGRATION_API_KEY", "externalIdentifier": "EXTERNAL_IDENTIFIER", "name": "CANDIDATE_NAME", "email": "CANDIDATE_EMAIL", "languageCode": "LANGUAGE_CODE", "sendEmail": true, "generateKioskCode": true, "testReading": false, "testListening": false, "callbackUrl": "https://YOUR_CALLBACK_URL", "returnUrl": "https://YOUR_RETURN_URL" } ``` Descriptions of the request object's fields: - `apiKey` - **required**, string - The API Key of the [Integration](https://www.linguapop.eu/docs/integrations) you're using. - `externalIdentifier` - **optional**, string, max length 500 - This is an ID you can generate from your CRM to uniquely identify your candidate. - `email` - **required**, string - The candidate's email address. This can also be used to identify your candidate. - `languageCode` - **required**, string - The `code` of the language you want to test. All language codes can be fetched using the [Fetch available languages endpoint](#fetch-available-languages). - `sendEmail` - **required**, boolean - This determines whether Linguapop sends an invitation email to your candidate. - `generateKioskCode` - **optional**, boolean - This determines whether Linguapop will generate and return a kiosk code for your candidate. - If set to `true`, ensure that a Kiosk has been enabled and set up within Customization. - `testReading` - **optional**, boolean - This determines whether the test will include a reading section. - If not provided, the default option set in your [Customization](https://www.linguapop.eu/docs/customization#additional-skills-tested) will be used. - `testListening` - **optional**, boolean - This determines whether the test will include a listening section. - If not provided, the default option set in your [Customization](https://www.linguapop.eu/docs/customization#additional-skills-tested) will be used. - `callbackUrl` - **optional**, string, max length 1000 - This is [the callback URL](#the-callback-url) to which a POST request will be sent with the results of the placement test once the test is completed. - `returnUrl` - **optional**, string, max length 1000 - The URL the candidate will be redirected to after completing the placement test. The redirect is triggered by a button on the results screen. - If not provided, the button will not be visible. The Linguapop API will respond with the following JSON object: ```json title="Response" { "invitationId": INVITATION_ID, "externalIdentifier": "EXTERNAL_IDENTIFIER", "url": "https://app.linguapop.eu/accept-placement-test-invitation/INVITATION_TOKEN", "emailSent": false, "kioskCode": "000000" } ``` Descriptions of the response object's fields: - `invitationId` - number (integer) - The unique ID of the created invitation. - You can save this property to track this particular placement test. - `url` - string - A direct URL to the placement test invitation. - This is the same URL used within Linguapop's placement test invitation emails. - You can provide this URL to your candidate in an automated workflow, such as a "Take a placement test" page on your website, or if you are using your own email sending service. - `emailSent` - boolean - Determines whether an email has been successfully sent - Is always `false` if you set `sendEmail` to false - `kioskCode` - string or `null` - The Kiosk Code that your candidate can use to access the placement test through your configured Kiosk - Is `null` if you set `generateKioskCode` to false :::tip **You don't have to send emails!** One of the best parts of Linguapop's API integration is that you get a direct link to the placement test for each invitation you send. Instead of sending emails, you can simply provide the candidate with this link while they are on your website, or you can even further customize your emails beyond what Linguapop provides With Linguapop being charged only for completed tests, you will not incur additional charges by providing website visitors with a self-service placement test. This makes Linguapop an ideal tool for acquiring high-quality leads. ::: #### The Callback URL Upon the completion of a placement test, Linguapop can optionally send the results of the placement test back to your software. All you need to do to enable this is provide the `callbackUrl` property as part of your request body for the [Send/create an invitation to a placement test](#sendcreate-an-invitation-to-a-placement-test) request. If a `callbackUrl` has been provided, Linguapop will make an HTTP **POST** request with a `Content-Type` header set to `application/json`, and the following body structure: ```json title="Callback request body" { "externalIdentifier": "EXTERNAL_IDENTIFIER", "invitationId": INVITATION_ID, "placementTestId": PLACEMENT_TEST_ID, "name": "CANDIDATE_NAME", "email": "CANDIDATE_EMAIL", "phone": "CANDIDATE_PHONE", "finalLevel": "B2 High", "finalLevelCode": "B2H", "reading": null, "readingMax": null, "listening": null, "listeningMax": null, "rating": 1652.7278254974933, "completedOn": "2023-08-14T13:58:06.391139Z", "publicResultsUrl": "PUBLIC_RESULTS_URL", "adminResultsUrl": "ADMIN_RESULTS_URL" } ``` Descriptions of the callback request object's fields: - `externalIdentifier` - string, **can be null**, max length 500 - This is an ID you can generate from your CRM to uniquely identify your candidate. - `invitationId` - number (integer) - The unique ID of the invitation. Same ID as the one you receive from Linguapop. - `placementTestId` - number (integer) - The unique ID of the placement test. You can use this to identify the placement test within the Linguapop app. - `name` - string - The name of the tested candidate. - `email` - string - The email of the tested candidate. - `phone` - string - The phone number of the tested candidate. - `finalLevel` - string - The final level Linguapop determined for the candidate, as a human-readable string. - `finalLevelCode` - string - The final level Linguapop determined for the candidate, as a unique machine-readable code. - `reading` - number (integer), **can be null** - The number of questions answered correctly for the reading task, if any. - Will be `null` if no reading task was performed. - `readingMax` - number (integer), **can be null** - The total number of questions for the reading task. - Will be `null` if no reading task was performed. - `listening` - number (integer), **can be null** - The number of questions answered correctly for the listening task, if any. - Will be `null` if no listening task was performed. - `listeningMax` - number (integer), **can be null** - The total number of questions for the listening task. - Will be `null` if no listening task was performed. - `rating` - number (floating point) - The system-determined rating for the candidate. - This rating corresponds to the level from the `finalLevel` and `finalLevelCode` fields. - For details, see [Levels used in Linguapop](#levels-used-in-linguapop) - `completedOn` - string, [ISO 8601](https://en.wikipedia.org/wiki/ISO_8601)-formatted UTC timestamp without offset - The date and time when the placement test has been completed. - This is an ISO 8601-formatted UTC timestamp, without an offset component. - `publicResultsUrl` - string - This is a direct link to the results page that your candidate can access. - `adminResultsUrl` - string - Use this URL if you want to display detailed results from within an `iframe` inside your application. - This link displays the candidate's name, email address and phone number, and should only be used to display detailed results to users who would normally be able to access the data through Linguapop. #### Levels used in Linguapop Linguapop is aligned with the CEFR, displaying final results to candidates as one of the 6 main levels: **A1, A2, B1, B2, C1, C2**. However, internally Linguapop tracks these levels in a more fine-grained manner, splitting the 6 main CEFR levels into 16 sub-levels: | Level name | Usually called | Level code | Lowest rating | Highest rating | | ----------- | -------------- | ---------- | ------------- | -------------- | | A1 Low | A1.1 | A1L | / | 849 | | A1 High | A1.2 | A1H | 850 | 949 | | A2 Low | A2.1 | A2L | 950 | 1049 | | A2 High | A2.2 | A2H | 1050 | 1149 | | B1 Low | B1.1 | B1L | 1150 | 1249 | | B1 Mid-Low | B1.2 | B1ML | 1250 | 1349 | | B1 Mid-High | B1.3 | B1MH | 1350 | 1449 | | B1 High | B1.4 | B1H | 1450 | 1549 | | B2 Low | B2.1 | B2L | 1550 | 1649 | | B2 Mid-Low | B2.2 | B2ML | 1650 | 1749 | | B2 Mid-High | B2.3 | B2MH | 1750 | 1849 | | B2 High | B2.4 | B2H | 1850 | 1949 | | C1 Low | C1.1 | C1L | 1950 | 2049 | | C1 High | C1.2 | C1H | 2050 | 2149 | | C2 Low | C2.1 | C2L | 2150 | 2249 | | C2 High | C2.2 | C2H | 2250 | / | You can use this table together with the `rating` result to create graphical representations of the candidate's rating within your own software. --- ## Zapier ### API key The Linguapop Zapier integration requires an active [Integration API key](https://www.linguapop.eu/docs/integrations#the-integration-api-key) for authentication. We suggest that you create a separate API key for your Zapier integration. ### Linguapop Integration The Linguapop Zapier integration consists of the following: - New Placement Test Result trigger - Create Placement Test Invitation action #### New Placement Test Result trigger When you create or activate a Zap using this trigger, Zapier sends a POST request to our server with your Integration API key and a callback URL of the Zap. We then store the URL in our database and send the placement test result data each time one of your candidates completes their placement test. You can have multiple active Zaps using the trigger and each active Zap will be triggered whenever your candidate completes their placement test. The trigger will send the following data to each active Zap: - `externalIdentifier` - string, **can be null**, max length 500 - This is an ID you can generate from your CRM to uniquely identify your candidate. - `invitationId` - number (integer) - The unique ID of the invitation. Same ID as the one you receive from Linguapop. - `placementTestId` - number (integer) - The unique ID of the placement test. You can use this to identify the placement test within the Linguapop app. - `name` - string - The name of the tested candidate. - `email` - string - The email of the tested candidate. - `phone` - string - The phone number of the tested candidate. - `finalLevel` - string - The final level Linguapop determined for the candidate, as a human-readable string. - `finalLevelCode` - string - The final level Linguapop determined for the candidate, as a unique machine-readable code. - `reading` - number (integer), **can be null** - The number of questions answered correctly for the reading task, if any. - Will be `null` if no reading task was performed. - `readingMax` - number (integer), **can be null** - The total number of questions for the reading task. - Will be `null` if no reading task was performed. - `listening` - number (integer), **can be null** - The number of questions answered correctly for the listening task, if any. - Will be `null` if no listening task was performed. - `listeningMax` - number (integer), **can be null** - The total number of questions for the listening task. - Will be `null` if no listening task was performed. - `rating` - number (floating point) - The system-determined rating for the candidate. - This rating corresponds to the level from the `finalLevel` and `finalLevelCode` fields. - For details, see [Levels used in Linguapop](https://www.linguapop.eu/docs/api#levels-used-in-linguapop) - `completedOn` - string, [ISO 8601](https://en.wikipedia.org/wiki/ISO_8601)-formatted UTC timestamp without offset - The date and time when the placement test has been completed. - This is an ISO 8601-formatted UTC timestamp, without an offset component. - `publicResultsUrl` - string - This is a direct link to the results page that your candidate can access. ```json title="Response" { "externalIdentifier": "EXTERNAL_IDENTIFIER", "invitationId": INVITATION_ID, "placementTestId": PLACEMENT_TEST_ID, "name": "CANDIDATE_NAME", "email": "CANDIDATE_EMAIL", "phone": "CANDIDATE_PHONE_NUMBER", "finalLevel": "B2 High", "finalLevelCode": "B2H", "reading": null, "readingMax": null, "listening": null, "listeningMax": null, "rating": 1652.7278254974933, "completedOn": "2023-08-14T13:58:06.391139Z", "publicResultsUrl": "PUBLIC_RESULTS_URL" } ``` When you deactivate or delete your Zap, Zapier will send a request to our server to deactivate the associated trigger. Our server will then no longer send the result data to that specific Zap. #### Create Placement Test Invitation action The action allows you to create and send a placement test invitation to your candidate. Input parameters: - `externalIdentifier` - **optional**, string, max length 500 - This is an ID you can generate from your CRM to uniquely identify your candidate. - `name` - **optional**, string - The candidate's name. This can be used to identify your candidate. - `email` - **required**, string - The candidate's email address. This can also be used to identify your candidate. - `languageCode` - **required**, string - The `code` of the language you want to test. All language codes will be listed in a dynamic dropdown. Supports custom strings but requires that [advanced Zapier conditions](https://www.linguapop.eu/docs/integrations#advanced-zapier-conditions) are set. - `sendEmail` - **required**, boolean - This determines whether Linguapop sends an invitation email to your candidate. - `testReading` - **optional**, boolean - This determines whether the test will include a reading section. - If not provided, the default option set in your [Customization](https://www.linguapop.eu/docs/customization#additional-skills-tested) will be used. - `testListening` - **optional**, boolean - This determines whether the test will include a listening section. - If not provided, the default option set in your [Customization](https://www.linguapop.eu/docs/customization#additional-skills-tested) will be used. - `returnUrl` - **optional**, string, max length 1000 - The URL the candidate will be redirected to after completing the placement test. The redirect is triggered by a button on the results screen. - If not provided, the button will not be visible. The action will return the following data to your Zap: ```json title="Response" { "invitationId": INVITATION_ID, "externalIdentifier": "EXTERNAL_IDENTIFIER", "url": "https://app.linguapop.eu/accept-placement-test-invitation/INVITATION_TOKEN", "emailSent": false } ``` --- ## FAQ ### General #### Is there a free trial available for Linguapop? You can create an account, customize your placement test branding and preview the placement tests and emails for free. Once you're ready to start administering placement tests, a subscription is required. #### How do I sign up for Linguapop? You can simply visit our [registration form](https://app.linguapop.eu/registration) to create a free account and try various features of Linguapop. Once you're ready to use Linguapop, you can subscribe directly from the dashboard. #### Can I add or remove users from my subscription to Linguapop easily? Yes, you can add and remove users within your organization. See [organization users](https://www.linguapop.eu/docs/organization-users) for details. #### How is user authentication and access control managed in Linguapop? When you register your organization on Linguapop you receive an Organization Administrator account within your organization. You can grant and revoke access to Linguapop for any number of users under your organization. #### Is there a limit to the number of users or devices I can have with Linguapop? Linguapop sets no limit to the number of users or devices. #### Can I use Linguapop on mobile devices? You can use Linguapop on both desktop and mobile devices, including tablets. #### Is there a mobile app for Linguapop? Linguapop is currently offered only as a web-based application. #### What industries does Linguapop cater to? Linguapop placement tests cater to schools and organizations (such as employers) who want to assess their candidate's language skills. #### Can I white-label or brand Linguapop for my business? Yes! Linguapop is designed to be customized so that the placement tests you administer use your logo and brand colors. #### What languages does Linguapop support? The user interface of Linguapop is entirely in English. Linguapop placement tests can be administered for 5 languages: English, German, Spanish, Italian and French. #### Can I get a demo of Linguapop before purchasing? Yes - you can contact us at [support@linguapop.eu](mailto:support@linguapop.eu) for a demonstration of the Linguapop interface and placement test. #### What happens if there is downtime with Linguapop? We strive to provide a high-quality, always available service in Linguapop. However, if there is downtime, all customer data is safe, and all placement test progress is saved. Both users and their candidates will be able to continue using Linguapop exactly where they left off once Linguapop is back online. #### Is there a service level agreement (SLA) in place for Linguapop? For our regular subscribers, we do not offer an SLA. If your organization requires an SLA, please contact us at [support@linguapop.eu](mailto:support@linguapop.eu) to make special arrangements. #### How do updates and new features get rolled out in Linguapop? Updates and features for Linguapop are rolled out as soon as they are available, and users are notified via a changelog. #### Is there a roadmap for future developments in Linguapop? We currently plan on expanding the number of languages we offer. We are 100% focused on our users, and your feedback means everything to us. If you have any suggestions and/or feedback, please let us know at [support@linguapop.eu](mailto:support@linguapop.eu). ### Integration #### Can I integrate Linguapop with other tools I use? You can integrate Linguapop with any existing software using [Linguapop's API](https://www.linguapop.eu/docs/api) or Zapier integration. You can also send placement test invitations via WhatsApp directly from the Linguapop interface. #### Does Linguapop offer API access? Yes - you can administer and get results for your placement tests either via the [Linguapop API](https://www.linguapop.eu/docs/api) or our Zapier integration. ### Support #### What type of customer support is available for Linguapop? In addition to our detailed documentation, Linguapop offers e-mail support for all subscribed customers. We usually respond to all queries within 1 business day. #### How can I contact customer support for Linguapop? You can contact customer support for Linguapop via e-mail: [support@linguapop.eu](mailto:support@linguapop.eu) #### What is the average response time for support inquiries with Linguapop? We usually respond to all inquiries within 1 business day. ### Payments and billing #### What payment plans are offered for Linguapop? Linguapop's main payment plan is a pay-as-you-go, post-paid model wherein users pay only for completed placement tests. Users can send as many placement tests as they want, and they will be charged only for the ones that have been completed. All completed placement tests are charged at the end of each billing cycle, which starts when you subscribe to Linguapop. Each billing cycle lasts one month. The current price per completed placement test is listed on our [pricing page](https://www.linguapop.eu/#pricing). #### Are there any hidden fees with Linguapop? Linguapop has no hidden fees - you only pay for the placement tests your candidates complete. #### Can I cancel my subscription to Linguapop at any time? Yes - you can cancel your Linguapop subscription at any time. However, if you have completed placement tests that weren't charged at the moment of cancellation, you will be charged for them. #### Does Linguapop offer company invoicing? Yes - when setting up your subscription, you enter the details of your company (including VAT number) and at the end of each billing cycle you will receive an invoice addressed to your company, including your company's VAT ID. #### What is the refund policy for Linguapop? We believe that we offer fair terms where customers pay only when Linguapop delivers them results. We do not offer refunds for completed placement tests. If you, however, feel that Linguapop didn't meet your needs, we'd love to hear from you and see how we can improve your experience. Feel free to contact us at [support@linguapop.eu](mailto:support@linguapop.eu) at any time with all your questions. #### Are there any volume discounts available for Linguapop? We do not generally offer volume discounts. However, if you are a large organization with a significant need, please contact us at [support@linguapop.eu](mailto:support@linguapop.eu) to see if an arrangement can be made. ### Data and privacy #### How often is data backed up in Linguapop? Data in Linguapop is backed up at least once every 24 hours. #### How is data migration handled in Linguapop? As Linguapop is mainly used to deliver ad-hoc placement tests, we do not offer any kind of data migration in or out of the system by default. #### Can I export my data from Linguapop? There is currently no feature in Linguapop that allows you to explicitly export your data. If you require an export, consider using the [Linguapop API](https://www.linguapop.eu/docs/api) or Zapier integration through which you can administer all your placement tests and get all data related to them directly within your own software. #### How does Linguapop handle compliance with data protection regulations? Linguapop is fully GDPR-compliant. Linguapop only stores the most necessary information required in order to deliver placement tests to your candidates. You may request from us to completely anonymize the data you have stored on Linguapop, such as the e-mails of your candidates and we will be happy to comply. All requests can be made to [support@linguapop.eu](mailto:support@linguapop.eu). We don't use 3rd-party cookies such as Google Analytics. Instead, we use Piwik PRO, which is a GDPR-compliant, 1st-party option with which we only collect essential user behavior data, such as page visits and in-page events. As a user, you have the option of opting in and out of our analytics tracking cookies by visiting our [Privacy policy](https://www.linguapop.eu/docs/privacy-policy) page. --- ## CEFR alignment ## Specification for Linguapop's alignment with CEFR *Last updated Aug 07, 2024* This document serves as the basis for the [Linguapop placement test](https://www.linguapop.eu)'s alignment with the [Common European Framework of Reference for Languages (CEFR)](https://www.coe.int/en/web/common-european-framework-reference-languages). Parts of the Specification were produced as part of Erasmus Key Action 2 project number 2020-1-HR01-KA204-077724. ### 1. Introduction This document deals with the content analysis of the Linguapop placement test in order to relate it to the CEFR from the point of view of coverage. The analysis in this case is the combined product of individual and group contemplation, research and discussion. The end product is a claim by the Linguapop team of a degree of linking to the CEFR based on specification, profiling the Linguapop placement test in relation to CEFR categories and levels. The claim is further supported by evidence of good practice, internal validity and adequate quality procedures for all the steps of the test development and administration cycle. The specification procedures outlined in this document involve four steps: - assuring adequate familiarisation with the CEFR; - analysing the content of the examination or test in question in relation to the relevant categories of the CEFR; should an area tested not be covered by the CEFR, the user is asked to describe it; - profiling the examination or test in relation to the relevant descriptor scales of the CEFR on the basis of this content analysis; - making a first claim on the basis of this content analysis that an examination or test in question is related to a particular level of the CEFR. The procedures involve three types of activity: - familiarisation activities as described in Chapter 3 of the Manual; - using a number of checklists to provide details about the content of the language examination; - using relevant CEFR descriptors to relate the language examination to the levels and categories of the CEFR. This Specification process gives examination providers the opportunity to: - increase the awareness of the importance of a good content analysis of examinations; - become familiar with and use the CEFR in planning and describing language examinations; - describe and analyse in a detailed way the content of an examination or test; - provide evidence of the quality of the examination or test; - provide evidence of the relation between examinations/tests and the CEFR; - provide guidance for item writers; - increase the transparency for teachers, testers, examination users and test takers about the content and quality of the examination or test and its relationship to the CEFR. The forms to be filled in have an awareness-raising function (process) and are also sources of evidence to support the claim made (product). ### 2. General description of the Linguapop placement test The first step in embarking on a linking project is to define and describe clearly the test that is going to be linked to the CEFR. Does the test have sufficient internal validity? Are there areas in which further development work would be advisable in order to increase or confirm the quality of the test and thus the meaningfulness of the result of the subsequent linking project? The process of describing the test provides an excellent opportunity to step back from operational concerns and reflect on the extent to which the examination, and procedures associated with it, was meeting its aims. The completion of the process relies on appropriate use of the Manual (Section A2 in the Appendix) and the following forms: A1: General Description of the Examination A2: Test Development A3: Marking A4: Grading A5: Reporting Results A6: Data Analysis A7: Rationale for Decisions ### 3. General information ##### 1. General **Name of Examination:** Linguapop placement test **Languages tested:** English (French, German, Italian, Spanish) **Examining institution:** Linguapop and associated partners **Versions analysed (date):** V1 (Jan 2022), V2 (Dec 2023) **Type of examination:** International Adaptive online Placement test **Purpose:** Initial placement test **Target population:** Young adults (>12 YOA), adults, general **No. of test takers per year:** over 3500 ##### 2. What is the overall aim? The overall aim of the Linguapop placement test is to provide a fast and accurate initial evaluation of language learners in line with CEFR standards in five languages, enabling accurate placement in a learning course. ##### 3. What are the more specific objectives? If available describe the needs of the intended users on which this examination is based. The more specific objectives include supporting the learner's motivation and learning strategies, as well as providing language schools and language training providers with an efficient tool for successful language teaching. ##### 4. What is/are the principal domain(s)? Public, personal, occupational and educational ##### 5. Which communicative activities are tested? 1. Use of language 2. Reading comprehension 3. Listening comprehension ##### 6. What is the weighting of the different subtests in the global result? 1. Use of language - 70% 2. Reading comprehension - 15% 3. Listening comprehension - 15% ##### 7. Describe briefly the structure of each subtest Use of language comprises multiple choice, ordering, open cloze, and gap fill tasks. Reading comprehension includes multiple choice tasks. Listening comprehension includes multiple choice tasks. ##### 8. What type(s) of responses are required? * Multiple-choice * True/False * Ordering * Sentence completion * Gapped text / cloze, selected response * Open gapped text / cloze ##### 9. What information is published for candidates and teachers? * Overall aim * Principal domain(s) * Test subtests * Test tasks * Sample test papers * Video of format * Sample answer papers * Standardised performance * Sample certificate ##### 10. Where is this accessible? * Inside the Linguapop application * On request from a testing institution ##### 11. What is reported? * Global grade plus graphic profile * Detailed analysis (viewable by testing institution) ### 4. History of the Linguapop placement test development **Test development** | **Short description and/or references** 1. What organisation decided that the examination was required? | The project partners have set the test profile based on the widespread need for efficient and accurate placement test for the five languages. 2. If an external organisation is involved, what influence do they have on design and development? | All Linguapop users give active feedback on the test's accuracy and their requirements, creating a closed loop of feedback for the further design and development of the test. 3. If no external organisation was involved, what other factors determined design and development of examination? | Although external organisations are involved, the initial development of Linguapop was based on: * A needs analysis * Internal description of examination aims * Internal description of language level * A syllabus or curriculum * Profile of candidates 4. In producing test tasks are specific features of candidates taken into account? | The following specific features have been taken into account, to an adequate degree: * Linguistic background (L1) * Language learning background * Age * Educational level * Socio-economic background * Social-cultural factors * Ethnic background * Gender 5. Who writes the items or develops the test tasks? | Project partners, assisted by local/regional associate partners, language teachers and members of community of practice 6. Do test writers have guidance to ensure quality? | * Training * Guidelines * Checklists * Examples of valid, reliable, appropriate tasks calibrated to CEFR level description 7. Is training for test writers provided? | Yes 8. Are test tasks discussed before use? | Yes 9. If yes, by whom? | * Individual colleagues * Internal group discussion * Internal stakeholders * External stakeholders 10. Are test tasks pretested? | Yes 11. If yes, how? | * Pilot testing sessions conducted by project partners * Continuous review and feedback sessions from users 12. If no, why not? | N/A 13. Is the reliability of the test estimated? | Yes 14. If yes, how? | * Data collection and psychometric procedures * Continuous review and feedback sessions from users * Independent estimation of individual tasks by language experts 15. Are different aspects of validity estimated? | Yes for all: * Face validity * Content validity * Concurrent validity * Predictive validity * Construct validity 16. If yes, describe how. | All aspects of validity are verified independently through an initial piloting phase, followed by independent review by language experts. Users of Linguapop provide additional feedback which is then implemented back into the contents of the placement test to increase validity. ### 5. Marking Marking | 1. How are the test tasks marked? | Computer software based on statistical matchmaking algorithms 2. Where are the test tasks marked? | Centrally, within the software itself 3. What criteria are used to select markers? | The software itself marks the tests. External markers may access the results of the test for further marking. 4. How is accuracy of marking promoted? | * Regular checks performed by project team * Regular checks performed by external providers * Feedback system for potentially faulty tasks * Automatic detection of outlier tasks based on statistical analysis 5. Describe the specifications of the rating criteria of productive and/or integrative test tasks. | * One holistic score for each task * Marks for different aspects for each task * Rating scale for overall performance in test * Rating grid for aspects of test performance * Rating scale for each task * Rating grid for aspects of each task * Rating scale bands are defined in relation to CEFR 6-9. Rating * Are productive or integrated test tasks single or double rated? * If double rated, what procedures are used when differences between raters occur? * Is inter-rater agreement calculated? * Is intra-rater agreement calculated? | * Linguapop is an automated tool for placement testing. Therefore, all tasks are single-rated by the tool by default. * An optional double-rating may be performed by a member of the testing institution's staff. * As Linguapop uses a statistical model for rating, inter-rater agreement is guaranteed. * Intra-rater agreement - between algorithm and staff members - is not calculated. ### 6. Grading and results Grading | 1. Are pass marks and/or grades given? | Grades 2. Describe the procedures used to establish pass marks and/or grades and cut scores | Grade boundaries are predefined in accordance with CEFR for each test item. 3. If only pass/fail is reported, how are the cut-off scores for pass/fail set? | N/A 4. If grades are given, how are the grade boundaries decided? | The CEFR scale is divided into sub-sections, with each sub-section being given a numeric rating. The candidate is assigned a grade according to the CEFR based on the sub-section closest to their rating at the end of the test. 5. How is consistency in these standards maintained? | Being an automated test tool based on stable statistical algorithms, consistency is guaranteed across all grades. Results | 1. What results are reported to candidates? | * Global grade * Grade per subtest 2. In what form are results reported? | * In form of standardised CEFR Level * Visual profile of global grade 3. On what document are results reported? | * On-line, at the end of the placement test * On-line, within an administrative section available to the testing institution 4. Is information provided to help candidates to interpret results? Give details. | Yes, information is provided to help candidates define their own CEFR level, together with recommendation regarding opportunities/ strategies for further learning. 5. Do candidates have the right to see the corrected and scored examination papers? | No. However, testing institutions may request the entire marked test. 6. Do candidates have the right to ask for remarking? | No. However, candidates may retake the test. Data analysis | 1. Is feedback gathered on the examinations? | Yes, via the test platform. 2. If yes, by whom? | * Internal experts * External experts * Test administrators 3. Is the feedback incorporated in revised versions of the examinations? | Yes 4. Is data collected to do analysis on the tests? | Yes. 5. If yes, indicate how data are collected? | * During pretesting, piloting and testing. * Data on success rates for each test task is collected for analysis. 6. For which features is analysis on the data gathered carried out? | * Difficulty * Discrimination * Reliability * Validity 7. State which analytic methods have been used (e.g. in terms of psychometric procedures). | * Repeat studies (to determine accuracy) * Comparison of expected vs. actual results based on teacher feedback * Comparison of results with other placement tests * Entry and exit testing - tracking progress 8. Are performances of candidates from different groups analysed? If so, describe how. | Yes, in pilot testing sessions, care is taken to engage different groups of test takers. 9. Describe the procedures to protect the confidentiality of data. | * Only necessary PII is collected (one or more of: name, email, phone number) * The results available to candidates (public) do not display candidate PII. * Only the testing institution has access to PII of their candidates. 10. Are relevant measurement concepts explained for test users? If so, describe how. | Yes. The test is accompanied with a rationale and instructions for users, including relevant measurement concepts as regards the evaluation of their initial L2 knowledge in line with CEFR. Rationale for decisions (and revisions) | Short description and/or reference Give the rationale for the decisions that have been made in relation to the examination or the test tasks in question. Is there a review cycle for the examination? (How often? Who by? Procedures for revising decisions) | All decisions in relation to the test tasks and algorithm are made based on continuous data influx from candidates taking the placement test. These incorporate testing institution feedback in addition to standard statistical data. The development of the placement test involves continual revision based on the incoming data. It is performed by the Linguapop development team in conjunction with external language experts and testing institutions. ##### Initial Estimation of Overall CEFR Level The Linguapop placement test covers CEFR levels from A1 to C2. ##### Short rationale, reference to documentation By utilizing matchmaking algorithms, Linguapop can quickly (within 10 language tasks) determine the approximate language skill level of the candidate. Further tasks are administered to confirm the candidate's language skill level, and achieve sub-level precision. ### 7. Listening comprehension *(part of Specification: Communicative Language Activities / Reception)* ##### 1. In what contexts (domains, situations, ...) are the test takers to show ability? The test takers are required to show ability in all four domains: personal, public, educational and professional (Table 5 in CEFR 4.1), depending on the level and selected combination of test items within their respective test experience. ##### 2. Which communication themes are the test takers expected to be able to handle? Communication themes handled by the test takers include: 1. personal identification 2. house and home, environment 3. daily life 4. free time, entertainment 5. travel 6. relations with other people 7. health and body care 8. education 9. shopping 10. food and drink 11. services 12. places 13. language 14. weather The above thematic areas can also be subcategorised as follows: 1. leisure 2. sports, hobbies and interests 3. internet, radio and TV 4. cinema, theatre, concert, etc.; exhibitions, museums, etc. 5. intellectual and artistic pursuits 6. press (lists in CEFR 4.2) ##### 3. Which communicative tasks, activities and strategies are the test takers expected to be able to handle? In aural reception (listening) activities the language user as listener receives and processes a spoken input produced by one or more speakers. Listening activities include: * listening to public announcements (information, instructions, warnings, etc.); * listening to media (radio, TV, recordings, cinema); * listening as a member of a live audience (theatre, public meetings, public lectures, entertainments, etc.); * listening to overheard conversations, etc. In each case the user may be listening: * for gist; * for specific information; * for detailed understanding; * for implications, etc. (Source: CEFR 4.3, 4.4.2.1) Comprehension tasks may be designed so that the input text may contain differing amounts of information or degrees of cognitive and/or organisational complexity, or different amounts of support (visuals, key words, prompts, charts, diagrams, etc.) may be made available to help learners. Input may be chosen for its relevance to the learner (motivation) or for reasons extrinsic to the learner. A text may be listened to up to three times. The type of response required can be quite simple (yes /no) or demanding (choose the best option). Linguapop draws among other things on the fact that individuals may differ considerably in their approach to the same task. Consequently the difficulty of any particular task for an individual, and the strategies which he or she adopts to cope with the demands of the task, are the result of a number of interrelated factors arising from his or her competences (general and communicative) and individual characteristics, and the specific conditions and constraints under which the task is carried out. For these reasons the ease or difficulty of tasks cannot be predicted with certainty, least of all for individual learners, and in language learning contexts consideration needs to be given to ways of building flexibility and differentiation into task design and implementation. In considering levels of task difficulty, therefore, Linguapop design takes into account: * user/learner's competences and characteristics, including the learner's own purposes and learning style; * task conditions and constraints which may affect the language user/learner's performance in carrying out specific tasks, and which, in learning contexts, may be adjusted to accommodate learner competences and characteristics (CEFR 7.1, 7.2 and 7.3) ##### 4. What text-types and what length of text are the test takers expected to be able to handle? Types of texts featured in Linguapop's listening comprehension subtest include: * public announcements and instructions; * public speeches, lectures, presentations, sermons; * entertainment (drama, shows, readings, songs); * sports commentaries (football, boxing, athletics, etc.); * news broadcasts; * public debates and discussion; * inter-personal dialogues and conversations; * telephone conversations; * job interviews. (CEFR 4.6) ##### 5. After reading the scale for Overall Listening Comprehension, given below, indicate and justify at which level(s) of the scale the subtest should be situated. Linguapop first tests the candidate's general use of language skills. Based on the result of the use of language section, an appropriate listening task is selected for the candidate, and marked upon completion. This ensures that the level of the listening task is approximately within the candidate's skill level, and gives an estimation of their listening skills in relation to their general use of language skills. ### 8. Reading comprehension *(part of Specification: Communicative Language Activities / Reception)* ##### 1. In what contexts (domains, situations, …) are the test takers to show ability? The test takers are required to show ability in all four domains: personal, public, educational and professional (Table 5 in CEFR 4.1), depending on the level and selected combination of test items within their respective test experience. ##### 2. Which communication themes are the test takers expected to be able to handle? Communication themes handled by the test takers include: 1. personal identification 2. house and home, environment 3. daily life 4. free time, entertainment 5. travel 6. relations with other people 7. health and body care 8. education 9. shopping 10. food and drink 11. services 12. places 13. language 14. weather The above thematic areas can also be subcategorised as follows: 1. leisure 2. sports, hobbies and interests 3. internet, radio and TV 4. cinema, theatre, concert, etc.; exhibitions, museums, etc. 5. intellectual and artistic pursuits 6. press (lists in CEFR 4.2) ##### 3. Which communicative tasks, activities and strategies are the test takers expected to be able to handle? In reading activities the candidate receives and processes a sample - usually a paragraph - of text. Reading activities include: * books, fiction and non-fiction, including literary journals; * magazines, newspapers; * instruction manuals (DIY, cookbooks, etc.); * textbooks; * comic strips; * brochures, prospectuses, leaflets; * advertising material; * public signs and notices; * supermarket, shop, market stall signs; * packaging and labelling on goods, tickets, etc.; * forms and questionnaires; * dictionaries (monolingual and bilingual), thesauri; * business and professional letters, emails, faxes; * personal letters; * essays and exercises; * memoranda, reports and papers; * notes and messages, etc.; * databases (news, literature, general information, etc.). In each case the user may be reading: * for gist; * for specific information; * for detailed understanding; * for implications, etc. (Source: CEFR 4.3, 4.4.2.1) Comprehension tasks may be designed so that the input text may contain differing amounts of information or degrees of cognitive and/or organisational complexity, or different amounts of support (visuals, key words, prompts, charts, diagrams, etc.) may be made available to help learners. Input may be chosen for its relevance to the learner (motivation) or for reasons extrinsic to the learner. A text may be read as often as necessary. The type of response required can be quite simple (yes /no) or demanding (choose the best option). Linguapop draws among other things on the fact that individuals may differ considerably in their approach to the same task. Consequently the difficulty of any particular task for an individual, and the strategies which he or she adopts to cope with the demands of the task, are the result of a number of interrelated factors arising from his or her competences (general and communicative) and individual characteristics, and the specific conditions and constraints under which the task is carried out. For these reasons the ease or difficulty of tasks cannot be predicted with certainty, least of all for individual learners, and in language learning contexts consideration needs to be given to ways of building flexibility and differentiation into task design and implementation. In considering levels of task difficulty, therefore, Linguapop takes into account: • user/learner's competences and characteristics, including the learner's own purposes and learning style; • task conditions and constraints which may affect the language user/learner's performance in carrying out specific tasks, and which, in learning contexts, may be adjusted to accommodate learner competences and characteristics (CEFR 7.1, 7.2 and 7.3) ##### 4. What text-types and what length of text are the test takers expected to be able to handle? Types of texts featured in Linguapop include: * books, fiction and non-fiction, including literary journals; * magazines, newspapers; * instruction manuals (DIY, cookbooks, etc.); * textbooks; * comic strips; * brochures, prospectuses, leaflets; * advertising material; * public signs and notices; * supermarket, shop, market stall signs; * packaging and labelling on goods, tickets, etc.; * forms and questionnaires; * dictionaries (monolingual and bilingual), thesauri; * business and professional letters, emails, faxes; * personal letters; * essays and exercises; * memoranda, reports and papers; * notes and messages, etc.; * databases (news, literature, general information, etc.). (CEFR 4.6) ##### 5. After reading the scale for Overall Reading Comprehension, given below, indicate and justify at which level(s) of the scale the subtest should be situated. Linguapop first tests the candidate's general use of language skills. Based on the result of the use of language section, an appropriate reading task is selected for the candidate, and marked upon completion. This ensures that the level of the reading task is approximately within the candidate's skill level, and gives an estimation of their reading skills in relation to their general use of language skills. ### 9. Interaction, spoken interaction and production, written production Linguapop's placement test coverage does not include spoken interaction or production in its main subtest suite. Testing institutions may subject their candidate to their own subtest to supplement Linguapop's assertion of the candidate's skill level. Written production is currently not covered, but it is being considered as an optional part of the placement test. However, testing institutions would have to mark the tasks themselves, with Linguapop serving exclusively as the testing medium. ### 10. Specification: Sources used in establishing communicative language competence The CEFR scales most relevant to Receptive skills have been used to create Table A3 (download), which can be referred to in this section. Table A3 does not include any descriptors for “plus levels”. The original scales consulted, some of which do define plus levels, include: General Linguistic Range | English: page 110 Vocabulary Range **Socio-linguistic Competence** | English: page 112 Socio-linguistic Appropriateness **Pragmatic Competence** | English: page 122 Thematic Development | English: page 125 Cohesion and Coherence | English: page 125 Propositional Precision **Strategic Competence** | English: page 129 Identifying Cues/Inferring | English: page 72 ### 11. Linguistic competence Linguistic Competence | Short description and/or reference 1. What is the range of lexical and grammatical competence that the test takers are expected to be able to handle? | Lexical competence, knowledge of, and ability to use, the vocabulary of a language, consists of lexical elements and grammatical elements. Lexical elements include: Fixed expressions, consisting of several words, which are used and learnt as wholes (sentential formulae, including direct exponents of language functions such as greetings, proverbs, relict archaisms), phrasal idioms, intensifiers, fixed frames, learnt and used as unanalysed wholes, into which words or phrases are inserted to form meaningful sentences (e.g.: "Please may I have..."), other fixed phrases, such as phrasal verbs, compound prepositions, fixed collocations, single word forms… Grammatical elements belong to closed word classes, e.g. (in English & other languages): * articles (a, the) * quantifiers (some, all, many, etc.) * demonstratives (this, that, these, those) * personal pronouns (I, we, he, she, it, they, me, you, etc.) * question words and relatives (who, what, which, where, etc.) * possessives (my, your, his, her, its, etc.) * prepositions (in, at, by, with, of, etc.) * auxiliary verbs (be, do, have, modals) * conjunctions (and, but, if, although) * particles (e.g. in German: ja, wohl, aber, doch, etc.) (CEFR 5.2.1.1 and 5.2.1.2) 2. After reading the scale for Linguistic Competence in Table A3, indicate and justify at which level(s) of the scale the examination should be situated. | The various elements of lexical and grammatical competence are embedded in the respective test items spanning the range from A1 to C2 of language competence, wherein the item level determines the level of its grammatical and lexical components that the test takers are expected to be able to handle. Socio-linguistic Competence | Short description and/or reference 3. What are the socio-linguistic competences that the test takers are expected to be able to handle: linguistic markers, politeness conventions, register, adequacy, dialect/accent, etc.? | Linguistic markers of social relations are widely divergent in different languages and cultures, depending on such factors as relative status, closeness of relation, register of discourse, etc. The examples given below for English are not universally applicable and are provided solely by way of example: * Use and choice of greetings: * on arrival, e.g. Hello! Good morning! * introductions, e.g. How do you do? * leave-taking, e.g. Good-bye . . . See you later * Use and choice of address forms: * frozen, e.g. My Lord, Your Grace * formal, e.g. Sir, Madam, Miss, Dr, Professor (+ surname) * informal, e.g. first name only, such as John! Susan! * informal, e.g. no address form * familiar, e.g. dear, darling; (popular) mate, love * peremptory, e.g. surname only, such as Smith! You (there)! * ritual insult, e.g. you stupid idiot! (often affectionate) * conventions for turntaking * use and choice of expletives (e.g. My God!, Bloody Hell!, etc.) Politeness conventions vary from one culture to another and are a frequent source of inter-ethnic misunderstanding, especially when literally interpreted. They include "positive" politeness (e.g.: showing interest in a person's well being, sharing experiences and concerns, "troubles talk", expressing admiration, affection, gratitude…), "negative" politeness (e.g.: avoiding face-threatening behaviour, expressing regret, apologising…), using hedges, appropriate use of "please", "thank you", etc., impoliteness, bluntness, frankness, expressing contempt, dislike...; Expressions of folk wisdom make a significant contribution to popular culture. They are frequently used, or perhaps more often referred to or played upon, for instance in newspaper headlines. A knowledge of this accumulated folk wisdom, expressed in language assumed to be known to all, is a significant component of the linguistic aspect of sociocultural competence. * proverbs, e.g. a stitch in time saves nine * idioms, e.g. a sprat to catch a mackerel * familiar quotations, e.g. a man's a man for that * expressions of: belief, such as - weathersaws, attitudes, etc. Register differences referring to systematic differences between varieties of language used in different contexts and implying differences in level of formality: * frozen, e.g. Pray silence for His Worship the Mayor! * formal, e.g. May we now come to order, please. * neutral, e.g. Shall we begin? * informal, e.g. Right. What about making a start? * familiar, e.g. O.K. Let's get going. * intimate, e.g. Ready dear? In developing Linguapop, and especially in determining the level of the test items, care is taken of the fact that in early learning (say up to level B1), a relatively neutral register is generally more appropriate. Conversely, acquaintance with more formal or more familiar registers is likely to come over a period of time, and at first as a receptive competence. Sociolinguistic competence also includes the ability to recognise the linguistic markers of, for example: * social class * regional provenance * national origin * ethnicity * occupational group Such markers include: * lexicon, e.g. Scottish wee for "small" * grammar, e.g. Cockney I ain't seen nothing for "I haven't seen anything" * phonology, e.g. New York "boid" for "bird" * vocal characteristics (rhythm, loudness, etc.) * paralinguistics * body language (CEFR 5.2.2) 4. After reading the scale for Sociolinguistic Competence in Table A3, indicate and justify at which level(s) of the scale the examination should be situated. | The various elements of Socio-linguistic competence are embedded in the respective test items spanning the range from A1 to C2 of language competence, wherein the item level determines the level of its Socio-linguistic components that the test takers are expected to be able to handle. ### 12. Pragmatic & strategic competence Pragmatic competence | Short description and/or reference 5. What are the pragmatic competences that the test takers are expected to be able to handle: discourse competences, functional competences? | Pragmatic competences are concerned with the user/learner's knowledge of the principles according to which messages are: * organised, structured and arranged ("discourse competence"); * used to perform communicative functions ("functional competence"); * sequenced according to interactional and transactional schemata ("design competence"). (CEFR 5.2.3) 6. After reading the scale for Pragmatic Competence in Table A3, indicate and justify at which level(s) of the scale the examination should be situated. | The various elements of pragmatic competence are embedded in the respective test items spanning the range from A1 to C2 of language competence, wherein the item level determines the level of its pragmatic components that the test takers are expected to be able to handle. Strategic Competence | Short description and/or reference 7. What are the strategic competences that the test takers are expected to be able to handle? | * Reception strategies involve: * identifying the context and knowledge of the world relevant to it, activating in the process what are thought to be appropriate schemata. * These in turn set up expectations about the organisation and content of what is to come (Framing). * During the process of receptive activity cues identified in the total context (linguistic and nonlinguistic) and the expectations in relation to that context set up by the relevant schemata are used to build up a representation of the meaning being expressed and a hypothesis as to the communicative intention behind it. * Through a process of successive approximation, apparent and possible gaps in the message are filled in order to flesh out the representation of meaning, and the significance of the message and of its constituent parts are worked out (Inferring). * The gaps filled through inference may be caused by linguistic restrictions, difficult receptive conditions, lack of associated knowledge, or by assumed familiarity, obliqueness, understatement or phonetic reduction on the part of the speaker/writer. * The viability of the current model arrived at through this process is checked against the evidence of the incoming co-textual and contextual cues to see if they "fit" the activated schema - the way one is interpreting the situation (Hypothesis testing). * An identified mismatch leads to a return to step one (Framing) in the search for an alternative schema which would better explain the incoming cues (Revising Hypotheses). * Planning: Framing (selecting mental set, activating schemata, setting up expectations). * Execution: Identifying cues and inferring from them. * Evaluation: Hypothesis testing: matching cues to schemata. * Repair: Revising hypotheses. (CEFR 4.4.2.4) 8. After reading the scale for Strategic Competence in Table A3, indicate and justify at which level(s) of the scale the examination should be situated. | The various elements of Strategic competence are embedded in the respective test items spanning the range from A1 to C2 of language competence, wherein the item level determines the level of its strategic components that the test takers are expected to be able to handle. ### 13. Mediation The question of which CEFR scales are most relevant to Mediation depends upon the type of mediation involved. In a foreign language context, one will naturally focus on the foreign language skill. Thus the language competences required in mediating from the foreign language to mother tongue will be primarily those required for reception, whilst for mediating from the mother tongue to the foreign language those for production will be necessary. For Mediation entirely in the foreign language, aspects of competence for both reception and production will be required. Linguapop does not currently test for mediation skills, nor are there plans for subsequent inclusion. ### 14. Specification: Outcome of the analysis Internal piloting, piloting with partner testing institutions and continuous analysis confirms that the Linguapop placement test covers the entirety of the CEFR scale across all tested competences. CEFR Level | Covered by Linguapop? A1 | * Use of language A1+ | * Use of language A2 | * Use of language * Reading comprehension * Listening comprehension A2+ | * Use of language * Reading comprehension * Listening comprehension B1 | * Use of language * Reading comprehension * Listening comprehension B1+ | * Use of language * Reading comprehension * Listening comprehension B2 | * Use of language * Reading comprehension * Listening comprehension B2+ | * Use of language * Reading comprehension * Listening comprehension C1 | * Use of language * Reading comprehension * Listening comprehension C1+ | * Use of language * Reading comprehension * Listening comprehension C2 | * Use of language * Reading comprehension * Listening comprehension