Evaluation Questionnaire
Evaluation Objectives
The main objective of the current questionnaire is to perform the overall evaluation of the Adapt4EE framework, considering:
• User Experience (D&E).
• The evaluation of the improvements brought by individual components of the Adapt4EE framework (for instance the occupancy modelling, the visual analytics components, and the comfort and occupancy-aware sensing infrastructure).
• And overall improvements of Adapt4EE-enabled new architectural designs, in terms of energy efficiency and user comfort.

In this framework, you are invited to answer the following questions that fall under 5 distinctive categories that are briefly described hereafter and are followed by the relevant questions.
Usability and Information Management
Usability is a broad term that incorporates better graphical representation of simulation input and output, simple navigation and flexible control. Information management is responsible for allowing assumptions using default values, facilitating data entry as well as customization and parameterization of the system. Building Performance Simulation (BPS) tools do not aim at replacing the judgment of experienced Designers and Engineers (D&E). Instead, they must support that judgement process. Thus, one of the most important selection and evaluation criteria of BPS is the ability to assist design teams and answer qualitative and quantitative design questions during the design process. Appropriately combining and visualizing all types and levels of information involved in the building performance simulation process is undoubtedly a heavily complex task. However, it becomes obvious from existing surveys that the focus is not on friendly and simple, easy to learn interfaces. Rather, D&E consider more important the ability to utilize various visualization techniques best fitting the information at hand (graphs, charts, time-series, comparative reports, etc.). Adapt4EE should aim at delivering different views to the BIM information fully customizable by the different end-users. End-Users should be able to customize the input parameters as well as the output form of the Adapt4EE tool.
Please declare your satisfaction concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Variety of Visualizations offered by the tool
Clear selection
Simulation and Evaluation of Building performance and provision of results analysis at any stage of the design process (early, intermediate, advanced) utilizing data of different detail levels
Clear selection
Provision of straightforward visualizations of energy, business and comfort KPIs
Clear selection
Provision of multi-parametric visualizations with the combination of energy, business and comfort Key Performance Indicators (KPIs)
Clear selection
Simultaneous comparative evaluation of alternative building designs
Clear selection
Generation of custom visualizations of individual and/or combined energy, business and comfort KPIs
Clear selection
Generation of custom visualizations of simulation outputs with extended spatiotemporal granularity
Clear selection
Generation of custom visualizations of simulation outputs, focusing on business parameters of the building
Clear selection
Generation of custom multi-parameter visualizations of simulation outputs utilizing combinations of spatiotemporal, business and KPI filters
Clear selection
Intuitiveness of the provided graphical visualizations of simulation outputs
Clear selection
Please declare the business facilitation level concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Alternative design decisions benchmarking facilitation on the basis of the visualizations offered
Clear selection
Facilitation of building performance assessment through the utilization of straightforward and multi-parameter visualizations, instead of tabular representations
Clear selection
Please declare the ease of use concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Comprehension of the graphical visualizations offered
Clear selection
Generation of custom filter-based visualizations of simulation outputs
Clear selection
Accuracy and Ability to Simulate Detailed and Complex Building Components
The accuracy and ability to simulate detailed and complex building components is the most popular selection criterion for BPS tools/products. This criterion includes all aspects regarding the validity and quality of simulation models and their resolution. Since the inception of BPS discipline, research has been carried out to provide analytical verification, empirical validation and comparative testing studies. Accuracy is concerned with all these aspects, in order to provide reliability and a level of quality assurance to the simulation results.
Please declare your satisfaction concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Provision of more realistic and valid simulation results due to the introduction of default domain-specific occupancy simulation models
Clear selection
More detailed assessment and high-resolution spatiotemporal analysis of energy consumption and overall building performance
Clear selection
Identification of realistic critical patterns and correlations among energy consumption and relevant contextual, business and occupants’ comfort parameters
Clear selection
Identification of more detailed and realistic patterns and correlations between energy, business, comfort and contextual parameters through analyzing, in higher spatiotemporal resolution, problematic building areas
Clear selection
Provision of quantitative information about the impact of energy reduction measures in the overall building performance as well as, to business performance and occupant’s comfort, through benchmarking of alternative energy reduction scenarios
Clear selection
Detailed and more realistic sensitivity analysis of design/occupancy parameters
Clear selection
Please declare the business facilitation level concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Facilitation of the building design optimization process on the basis of more detailed spatiotemporal analysis and more realistic correlation of energy, business, occupancy and contextual information, identification, of influential parameters, outliers and patterns and benchmarking between alternative design decisions
Clear selection
Facilitation in optimizing decisions for the application of energy reduction measures, through the identification, in a more realistic manner, of their impact in the overall building performance, as well as, to business performance and occupants’ comfort
Clear selection
Integration of Knowledge Base
This criterion supports decision-making and provides quantitative and qualitative advice regarding the influence of design decisions. This criterion also includes the finding of quantifiable answers to design questions in order to create context specific analysis, evaluate complex design strategies, optimize design solutions, engage “what if” scenarios, verify compliance, and analyse economic aspects. With the increasing analytical power of BPS tools we can examine sensitivity and uncertainty of key parameters in relation to design-decisions, compare various concepts, rank, quantify parametric and even generate semi-automatically design alternatives.
Please declare your satisfaction concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Optimization of building performance through the evaluation and benchmarking of alternative what-if design scenarios
Clear selection
Optimization of building performance through the evaluation and benchmarking of alternative what-if occupancy scenarios
Clear selection
Building performance optimization through the evaluation of complex design and/or occupancy scenarios
Clear selection
Quantification and Ranking of Design/Occupancy Alternatives
Clear selection
Identification of most influential design parameters, through visualization, filtering and alternatives comparison
Clear selection
Identification of patterns and correlations between energy, business, comfort and contextual parameters
Clear selection
Identification of problematic design decisions, at any time through the design process
Clear selection
Building performance evaluation using a simplified version of the building operational rating KPI
Clear selection
Ranking of alternative design/occupancy scenarios based on a simplified version of building operational rating
Clear selection
Please declare the business facilitation level concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Facilitation of Building Design and Performance Optimization Process through comparison and ranking of alternative design/occupancy scenarios
Clear selection
Facilitation of building design decision making process through the identification of patterns, influential parameters and correlations and the ability to spatially drill down and temporally analyze problematic areas
Clear selection
Facilitation in assessing Building Performance with the provided Energy, Business and Comfort KPIs
Clear selection
Facilitation and acceleration of building design process through the identification of problematic design decisions from the early design stages
Clear selection
Other
Please rate your overall experience with the Adapt4EE tool with regards to the following aspects. Rate the following apects using a 1-10 scale (1-totally bad at all; 10- Excellent).
Overall satisfaction regarding tool's features and functionality
Clear selection
Frequency of system's failures
Clear selection
Criticality of system's failures
Clear selection
Fit for purpose (the tool is fulfilling the expressed needs and it fits for the purpose it was developed)
Clear selection
Overall Simplicity in use
Clear selection
Easiness and straightforwardness to reach a novice level of tool usage
Clear selection
Easiness and straightforwardness to reach an advanced level of tool usage
Clear selection
Level of overall aesthetic attractiveness to the end users
Clear selection
Comments
Please add any further comment, concern and/or suggestion you may wish to share with us:
Demographic
Are you a student or a professional? *
Submit
Never submit passwords through Google Forms.
This content is neither created nor endorsed by Google.