Evaluation Questionnaire
* Required
Evaluation Objectives
The main objective of the current questionnaire is to perform the overall evaluation of the Adapt4EE framework, considering: • User Experience (D&E). • The evaluation of the improvements brought by individual components of the Adapt4EE framework (for instance the occupancy modelling, the visual analytics components, and the comfort and occupancy-aware sensing infrastructure). • And overall improvements of Adapt4EE-enabled new architectural designs, in terms of energy efficiency and user comfort. In this framework, you are invited to answer the following questions that fall under 5 distinctive categories that are briefly described hereafter and are followed by the relevant questions.
Usability and Information Management
Usability is a broad term that incorporates better graphical representation of simulation input and output, simple navigation and flexible control. Information management is responsible for allowing assumptions using default values, facilitating data entry as well as customization and parameterization of the system. Building Performance Simulation (BPS) tools do not aim at replacing the judgment of experienced Designers and Engineers (D&E). Instead, they must support that judgement process. Thus, one of the most important selection and evaluation criteria of BPS is the ability to assist design teams and answer qualitative and quantitative design questions during the design process. Appropriately combining and visualizing all types and levels of information involved in the building performance simulation process is undoubtedly a heavily complex task. However, it becomes obvious from existing surveys that the focus is not on friendly and simple, easy to learn interfaces. Rather, D&E consider more important the ability to utilize various visualization techniques best fitting the information at hand (graphs, charts, time-series, comparative reports, etc.). Adapt4EE should aim at delivering different views to the BIM information fully customizable by the different end-users. End-Users should be able to customize the input parameters as well as the output form of the Adapt4EE tool.
Please declare your satisfaction concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Variety of Visualizations offered by the tool
1
2
3
4
5
6
7
8
9
10
This is a required question
Simulation and Evaluation of Building performance and provision of results analysis at any stage of the design process (early, intermediate, advanced) utilizing data of different detail levels
1
2
3
4
5
6
7
8
9
10
This is a required question
Provision of straightforward visualizations of energy, business and comfort KPIs
1
2
3
4
5
6
7
8
9
10
This is a required question
Provision of multi-parametric visualizations with the combination of energy, business and comfort Key Performance Indicators (KPIs)
1
2
3
4
5
6
7
8
9
10
This is a required question
Simultaneous comparative evaluation of alternative building designs
1
2
3
4
5
6
7
8
9
10
This is a required question
Generation of custom visualizations of individual and/or combined energy, business and comfort KPIs
1
2
3
4
5
6
7
8
9
10
This is a required question
Generation of custom visualizations of simulation outputs with extended spatiotemporal granularity
1
2
3
4
5
6
7
8
9
10
This is a required question
Generation of custom visualizations of simulation outputs, focusing on business parameters of the building
1
2
3
4
5
6
7
8
9
10
This is a required question
Generation of custom multi-parameter visualizations of simulation outputs utilizing combinations of spatiotemporal, business and KPI filters
1
2
3
4
5
6
7
8
9
10
This is a required question
Intuitiveness of the provided graphical visualizations of simulation outputs
1
2
3
4
5
6
7
8
9
10
This is a required question
Please declare the business facilitation level concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Alternative design decisions benchmarking facilitation on the basis of the visualizations offered
1
2
3
4
5
6
7
8
9
10
This is a required question
Facilitation of building performance assessment through the utilization of straightforward and multi-parameter visualizations, instead of tabular representations
1
2
3
4
5
6
7
8
9
10
This is a required question
Please declare the ease of use concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Comprehension of the graphical visualizations offered
1
2
3
4
5
6
7
8
9
10
This is a required question
Generation of custom filter-based visualizations of simulation outputs
1
2
3
4
5
6
7
8
9
10
This is a required question
Accuracy and Ability to Simulate Detailed and Complex Building Components
The accuracy and ability to simulate detailed and complex building components is the most popular selection criterion for BPS tools/products. This criterion includes all aspects regarding the validity and quality of simulation models and their resolution. Since the inception of BPS discipline, research has been carried out to provide analytical verification, empirical validation and comparative testing studies. Accuracy is concerned with all these aspects, in order to provide reliability and a level of quality assurance to the simulation results.
Please declare your satisfaction concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Provision of more realistic and valid simulation results due to the introduction of default domain-specific occupancy simulation models
1
2
3
4
5
6
7
8
9
10
This is a required question
More detailed assessment and high-resolution spatiotemporal analysis of energy consumption and overall building performance
1
2
3
4
5
6
7
8
9
10
This is a required question
Identification of realistic critical patterns and correlations among energy consumption and relevant contextual, business and occupants’ comfort parameters
1
2
3
4
5
6
7
8
9
10
This is a required question
Identification of more detailed and realistic patterns and correlations between energy, business, comfort and contextual parameters through analyzing, in higher spatiotemporal resolution, problematic building areas
1
2
3
4
5
6
7
8
9
10
This is a required question
Provision of quantitative information about the impact of energy reduction measures in the overall building performance as well as, to business performance and occupant’s comfort, through benchmarking of alternative energy reduction scenarios
1
2
3
4
5
6
7
8
9
10
This is a required question
Detailed and more realistic sensitivity analysis of design/occupancy parameters
1
2
3
4
5
6
7
8
9
10
This is a required question
Please declare the business facilitation level concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Facilitation of the building design optimization process on the basis of more detailed spatiotemporal analysis and more realistic correlation of energy, business, occupancy and contextual information, identification, of influential parameters, outliers and patterns and benchmarking between alternative design decisions
1
2
3
4
5
6
7
8
9
10
This is a required question
Facilitation in optimizing decisions for the application of energy reduction measures, through the identification, in a more realistic manner, of their impact in the overall building performance, as well as, to business performance and occupants’ comfort
1
2
3
4
5
6
7
8
9
10
This is a required question
Integration of Knowledge Base
This criterion supports decision-making and provides quantitative and qualitative advice regarding the influence of design decisions. This criterion also includes the finding of quantifiable answers to design questions in order to create context specific analysis, evaluate complex design strategies, optimize design solutions, engage “what if” scenarios, verify compliance, and analyse economic aspects. With the increasing analytical power of BPS tools we can examine sensitivity and uncertainty of key parameters in relation to design-decisions, compare various concepts, rank, quantify parametric and even generate semi-automatically design alternatives.
Please declare your satisfaction concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Optimization of building performance through the evaluation and benchmarking of alternative what-if design scenarios
1
2
3
4
5
6
7
8
9
10
This is a required question
Optimization of building performance through the evaluation and benchmarking of alternative what-if occupancy scenarios
1
2
3
4
5
6
7
8
9
10
This is a required question
Building performance optimization through the evaluation of complex design and/or occupancy scenarios
1
2
3
4
5
6
7
8
9
10
This is a required question
Quantification and Ranking of Design/Occupancy Alternatives
1
2
3
4
5
6
7
8
9
10
This is a required question
Identification of most influential design parameters, through visualization, filtering and alternatives comparison
1
2
3
4
5
6
7
8
9
10
This is a required question
Identification of patterns and correlations between energy, business, comfort and contextual parameters
1
2
3
4
5
6
7
8
9
10
This is a required question
Identification of problematic design decisions, at any time through the design process
1
2
3
4
5
6
7
8
9
10
This is a required question
Building performance evaluation using a simplified version of the building operational rating KPI
1
2
3
4
5
6
7
8
9
10
This is a required question
Ranking of alternative design/occupancy scenarios based on a simplified version of building operational rating
1
2
3
4
5
6
7
8
9
10
This is a required question
Please declare the business facilitation level concerning the listed functions based on your experience with the use of the Adapt4EE tool. Rate the following functions using a 1-10 scale (1-not satisfied at all; 10- Totally satisfied).
Facilitation of Building Design and Performance Optimization Process through comparison and ranking of alternative design/occupancy scenarios
1
2
3
4
5
6
7
8
9
10
This is a required question
Facilitation of building design decision making process through the identification of patterns, influential parameters and correlations and the ability to spatially drill down and temporally analyze problematic areas
1
2
3
4
5
6
7
8
9
10
This is a required question
Facilitation in assessing Building Performance with the provided Energy, Business and Comfort KPIs
1
2
3
4
5
6
7
8
9
10
This is a required question
Facilitation and acceleration of building design process through the identification of problematic design decisions from the early design stages
1
2
3
4
5
6
7
8
9
10
This is a required question
Other
Please rate your overall experience with the Adapt4EE tool with regards to the following aspects. Rate the following apects using a 1-10 scale (1-totally bad at all; 10- Excellent).
Overall satisfaction regarding tool's features and functionality
1
2
3
4
5
6
7
8
9
10
This is a required question
Frequency of system's failures
1
2
3
4
5
6
7
8
9
10
This is a required question
Criticality of system's failures
1
2
3
4
5
6
7
8
9
10
This is a required question
Fit for purpose (the tool is fulfilling the expressed needs and it fits for the purpose it was developed)
1
2
3
4
5
6
7
8
9
10
This is a required question
Overall Simplicity in use
1
2
3
4
5
6
7
8
9
10
This is a required question
Easiness and straightforwardness to reach a novice level of tool usage
1
2
3
4
5
6
7
8
9
10
This is a required question
Easiness and straightforwardness to reach an advanced level of tool usage
1
2
3
4
5
6
7
8
9
10
This is a required question
Level of overall aesthetic attractiveness to the end users
1
2
3
4
5
6
7
8
9
10
This is a required question
Comments
Please add any further comment, concern and/or suggestion you may wish to share with us:
This is a required question
Demographic
Are you a student or a professional?
*
Student
Professional (<5 years experience)
Professional (<10 years experience)
Professional (>10 years experience)
This is a required question
Never submit passwords through Google Forms.
100%: You made it.