1 of 78

Freya, Hopac, Kestrel:

Building a Concurrent, Functional

Web Service for .NET Core

Marcus Griep

@neoeinstein�https://goo.gl/L77RHj

2 of 78

Marcus Griep

Lead Software Engineer

Vistaprint

With Vistaprint for 10 years
Using F# since 2015
Contributor to Chiron & Hopac
Twitter: @neoeinstein

@neoeinstein�https://goo.gl/L77RHj

3 of 78

@neoeinstein�https://goo.gl/L77RHj

4 of 78

Hopac

@neoeinstein�https://goo.gl/L77RHj

5 of 78

Functional

Web Services

@neoeinstein�https://goo.gl/L77RHj

6 of 78

@neoeinstein�https://goo.gl/L77RHj

7 of 78

OS: Debian 8

GCE 4 vCPU, 4GB

Published self-contained

5.98

@neoeinstein�https://goo.gl/L77RHj

8 of 78

freya.io

@neoeinstein�https://goo.gl/L77RHj

9 of 78

NuGet

Freya

Freya.Hopac

@neoeinstein�https://goo.gl/L77RHj

10 of 78

https://www.myget.org

/F/neoeinstein/api/v3/index.json

@neoeinstein�https://goo.gl/L77RHj

11 of 78

@neoeinstein�https://goo.gl/L77RHj

12 of 78

Should I use Freya?

Like to write clean functional code
Using .NET Framework or .NET Core
Don't want to have to read the HTTP RFCs
Want a powerful framework that understands HTTP
Want to benefit from the power and speed of Kestrel
Want a framework that optimizes itself

@neoeinstein�https://goo.gl/L77RHj

13 of 78

Should I use Freya?

@neoeinstein�https://goo.gl/L77RHj

14 of 78

Hopac

Concurrent ML-style constructs for F#

@neoeinstein�https://goo.gl/L77RHj

15 of 78

Should I use Hopac?

Want more performance out of asynchronous code
Know how to use Async<'a>
Familiar with the async computation expression
Have many short threads of execution that you want to run concurrently

Like on a web server

@neoeinstein�https://goo.gl/L77RHj

16 of 78

CPU

Hopac

Thread Pool

Cooperative

Preemptive

@neoeinstein�https://goo.gl/L77RHj

17 of 78

Should I use Hopac?

@neoeinstein�https://goo.gl/L77RHj

18 of 78

job { … }

@neoeinstein�https://goo.gl/L77RHj

19 of 78

Alt<'a>

Promise<'a>

IVar<'a>

MVar<'a>

>>=

^=>

*<-

*<+->=

Stream<'a>

Mailbox<'a>

@neoeinstein�https://goo.gl/L77RHj

20 of 78

Hopac

Async

@neoeinstein�https://goo.gl/L77RHj

21 of 78

Kestrel

The ASP.NET Core web server

@neoeinstein�https://goo.gl/L77RHj

22 of 78

Should I use Kestrel?

@neoeinstein�https://goo.gl/L77RHj

23 of 78

Should I use Kestrel?

@neoeinstein�https://goo.gl/L77RHj

24 of 78

OWIN

Open Web Interface for .NET

@neoeinstein�https://goo.gl/L77RHj

25 of 78

Should I use Kestrel?

@neoeinstein�https://goo.gl/L77RHj

26 of 78

Suave

@neoeinstein�https://goo.gl/L77RHj

27 of 78

Functional

Web Services

@neoeinstein�https://goo.gl/L77RHj

28 of 78

@neoeinstein�https://goo.gl/L77RHj

29 of 78

@neoeinstein�https://goo.gl/L77RHj

30 of 78

Kestrel

Freya

Apache / nginx / IIS

OWIN

Suave

ASP.NET�MVC

@neoeinstein�https://goo.gl/L77RHj

31 of 78

ASP.NET

type HelloHandler = HelloHandler of (string option -> string)

module HelloHandler =

let run (HelloHandler f) x = f x

let impl = HelloHandler <| function

| Some name -> sprintf "Hello %s!" name

| None -> "Hello World!"

[<Route("hello")>]

type HelloController (handler:HelloHandler) =

inherit Controller()

[<HttpGet>]

member x.Get() =

base.Ok(HelloHandler.run handler None)

[<HttpGet("{name}")>]

member x.GetByName(name: string) =

base.Ok(HelloHandler.run handler (Some name))

@neoeinstein�https://goo.gl/L77RHj

32 of 78

Suave

let helloWorld : WebPart =

choose

[ GET >=> path "/hello" >=> (Successful.OK "Hello World!")

GET >=> pathScan "/hello/%s" (sprintf "Hello %s!" >> Successful.OK) ]

@neoeinstein�https://goo.gl/L77RHj

33 of 78

Freya

let sayHello = freya {

let! uO = Freya.Optic.get (Route.atom_ "name")

let helloStr =

uO

|> Option.map (sprintf "Hello, %s!")

|> Option.defaultValue "Hello, World!"

return Represent.text helloStr

}

let helloMachine = freyaMachine {

handleOk sayHello

}

let router = freyaRouter {

resource "/hello{/name}" helloMachine

}

let root = UriTemplateRouter.Freya router

@neoeinstein�https://goo.gl/L77RHj

34 of 78

ASP.NET

[<Route("hello")>]

type HelloController () =

[<HttpGet>]

member x.Get() =

[<HttpGet("{name}")>]

member x.GetByName(name: string) =

@neoeinstein�https://goo.gl/L77RHj

35 of 78

Suave

let helloWorld =

choose

[ GET >=> path "/hello"

GET >=> pathScan "/hello/%s" ]

@neoeinstein�https://goo.gl/L77RHj

36 of 78

Freya

let name_ = Route.atom_ "name"

let router = freyaRouter {

resource "/hello{/name}" helloMachine

}

@neoeinstein�https://goo.gl/L77RHj

37 of 78

ASP.NET

[<Authorize>]

type HelloController () =

type MyRequirement () =

interface IAuthorizationRequirement

type MyAuthHandler () =

inherit AuthorizationHandler<MyRequirement>()

member __.HandleRequirementAsync(ctx:AuthorizationHandlerContext, req:MyRequirement) =

ctx.Succeed(req)

Task.CompletedTask

type Startup () =

member __.ConfigureServices(svc:IServiceCollection) =

svc.AddSingleton<IAuthorizationHandler,MyAuthHandler>()

svc.AddIdentity<IdentityType, IdentityRole>()

.WithSomeBackingStore()

@neoeinstein�https://goo.gl/L77RHj

38 of 78

Suave

let checkAllowed (user,pass) = true

Authentication.authenticateBasic checkAllowed (Successful.OK "You're in!")

@neoeinstein�https://goo.gl/L77RHj

39 of 78

Freya

let checkValidAuth = freya { return true }

let checkAllowed = freya { return true }

let helloMachine = freyaMachine {

authorized checkValidAuth

allowed checkAllowed

handleOk (Represent.text "You're in!")

}

@neoeinstein�https://goo.gl/L77RHj

40 of 78

Freya

Suave

path "/hello" >=> choose

[ GET >=> Successful.OK "hello"

Writers.setHeader "Allow" "GET" >=> RequestErrors.METHOD_NOT_ALLOWED "" ]

let helloMachine = freyaMachine {

methods [GET; HEAD; OPTIONS]

handleOk (Represent.text "You're in!")

}

@neoeinstein�https://goo.gl/L77RHj

41 of 78

Freya

let helloMachine = freyaMachine {

availableMediaTypes [MediaType.Json; MediaType.Text]

availableContentCodings ContentCoding.GZip

availableCharsets Charset.Utf8

handleOk (fun (acpt: Acceptable) -> freya { … })

}

@neoeinstein�https://goo.gl/L77RHj

42 of 78

Freya

let helloMachine = freyaMachine {

methods [GET; HEAD; OPTIONS; POST]

availableMediaTypes [MediaType.Json; MediaType.Text]

availableContentCodings ContentCoding.GZip

availableCharsets Charset.Utf8

acceptableMediaTypes MediaType.Json

handlePost doThePost

handleOk (fun (acpt: Acceptable) -> freya { … })

}

@neoeinstein�https://goo.gl/L77RHj

43 of 78

Freya

let helloMachine = freyaMachine {

cors

corsMaxAge (60*60*24)

corsOrigins (SerializedOrigin.parse "https://example.com")

methods [GET; HEAD; OPTIONS; POST]

availableMediaTypes [MediaType.Json; MediaType.Text]

availableContentCodings ContentCoding.GZip

availableCharsets Charset.Utf8

acceptableMediaTypes MediaType.Json

handlePost doThePost

handleOk (fun (acpt: Acceptable) -> freya { … })

}

@neoeinstein�https://goo.gl/L77RHj

44 of 78

Freya

let core = freyaMachine {

cors

corsMaxAge (60*60*24)

corsOrigins (SerializedOrigin.parse "https://example.com")

methods [GET; HEAD; OPTIONS]

availableContentCodings ContentCoding.GZip

availableCharsets Charset.Utf8

}

let helloMachine = freyaMachine {

including core

methods [GET; HEAD; OPTIONS; POST]

availableMediaTypes [MediaType.Json; MediaType.Text]

acceptableMediaTypes MediaType.Json

handlePost doThePost

handleOk (fun (acpt: Acceptable) -> freya { … })

}

@neoeinstein�https://goo.gl/L77RHj

45 of 78

Freya Machine

@neoeinstein�https://goo.gl/L77RHj

46 of 78

Freya Machines

Decision Trees

Is the server in a state to respond?� true: continue� false: return "503 Service Unavailable"��Is the version of HTTP being requested supported?� true: continue� false: return "505 HTTP Version Not Supported"

@neoeinstein�https://goo.gl/L77RHj

47 of 78

@neoeinstein�https://goo.gl/L77RHj

48 of 78

Freya Machine

@neoeinstein�https://goo.gl/L77RHj

49 of 78

Freya Machine

@neoeinstein�https://goo.gl/L77RHj

50 of 78

Freya Machine

Optimization

@neoeinstein�https://goo.gl/L77RHj

51 of 78

@neoeinstein�https://goo.gl/L77RHj

52 of 78

@neoeinstein�https://goo.gl/L77RHj

53 of 78

@neoeinstein�https://goo.gl/L77RHj

54 of 78

@neoeinstein�https://goo.gl/L77RHj

55 of 78

@neoeinstein�https://goo.gl/L77RHj

56 of 78

@neoeinstein�https://goo.gl/L77RHj

57 of 78

@neoeinstein�https://goo.gl/L77RHj

58 of 78

Freya Machine

Prototype

@neoeinstein�https://goo.gl/L77RHj

59 of 78

Freya Machine

Configuration

@neoeinstein�https://goo.gl/L77RHj

60 of 78

Freya Machine

Literal elimination

@neoeinstein�https://goo.gl/L77RHj

61 of 78

Freya Machine

Unary elimination

@neoeinstein�https://goo.gl/L77RHj

62 of 78

Freya Machine

Subgraph elimination

@neoeinstein�https://goo.gl/L77RHj

63 of 78

Freya Machine

Minimal

@neoeinstein�https://goo.gl/L77RHj

64 of 78

@neoeinstein�https://goo.gl/L77RHj

65 of 78

Demo

http://localhost:8080/trace/hello

@neoeinstein�https://goo.gl/L77RHj

Minimal machine

let helloMachine = freyaMachine {

// availableMediaTypes MediaType.Text

httpVersionSupported true

methods [GET; HEAD]

handleOk sayHello

}

Add authentication

open Authentication

let isAuthorized = BasicAuth.isAuthorized <| fun (Username u) (Password p) -> freya {

match u, p with

| "marcus", "test"

| "superUser", "superPassword"

| "anonymous", _ -> return true

| _ -> return false

}

let superUserOnly = freya {

let! user = Authentication.user

match user with

| (Some (Username "superUser")) -> return true

| _ -> return false

}

let core = freyaMachine {

including (basicAuth "demoRealm")

methods [GET; HEAD; OPTIONS]

authorized isAuthorized

}

including core

allowed superUserOnly

handleForbidden (Represent.text "Superuser privileges required")

let logoutMachine = freyaMachine {

including core

authorized false

}

resource "/logout" logoutMachine

Say Hello based on logged in user

let helloName = freya {

let! routeName = Freya.Optic.get routeName_

let! uO = Authentication.user

return

match routeName, uO with

| Some name, _

| None, Some (Username name) -> Some name

| _ -> None

}

let sayHello = freya {

let! nameO = helloName

let helloStr =

match nameO with

| Some name -> sprintf "Hello, %s!" name

| None -> "Hello, World!"

return Represent.text helloStr

}

Manipulating machine to add CORS

cors

corsMethods [GET; HEAD; OPTIONS]

corsHeaders ["Server"]

corsOrigins (SerializedOrigin.parse "http://example.com")

corsMaxAge (60*60*24)

Adding ETags for cache validation and concurrency

let helloEtag = freya {

let! nameO = helloName

return EntityTag.Weak <| string (hash nameO)

}

Freya.memo

entityTag helloEtag

66 of 78

Benchmarks

@neoeinstein�https://goo.gl/L77RHj

67 of 78

/hello{/name}

@neoeinstein�https://goo.gl/L77RHj

68 of 78

256 connections

10 sec

Google Compute Engine Instance

4 vCPUs, 4GiB RAM

Google Compute Engine Instance

2 vCPUs, 2GiB RAM

wrk

dotnet helloWorld.dll

/hello{/name}

@neoeinstein�https://goo.gl/L77RHj

69 of 78

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/hello

OS: Debian 8

GCE 4 vCPU, 4GB

Published self-contained

@neoeinstein�https://goo.gl/L77RHj

Response time were recorded for 50th, 75th, 90th, and 99th percentile.

Graph starts at 50th percentile, and is logarithmic in the vertical scale. The bottom is 5ms, with the top being 1s

Notes:

Freya on Hopac is comparable to MVC, with its timing being approximately 2x for the whole distribution, and narrowing the gap in the 99th percentile
Freya on Async is similar, taking about 2x the time of Freya on Hopac
Suave trailed the others, with a median response about 9x Freya on Hopac and a 99th percentile over 30x

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/hello

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/hello/fred

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/missing

Freya on Hopac (291656 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 13.53ms 2.80ms 105.62ms 87.11%

Req/Sec 595.74 52.12 1.26k 91.01%

Latency Distribution

50% 13.16ms

75% 13.63ms

90% 15.59ms

99% 22.96ms

190610 requests in 10.10s, 26.36MB read

Requests/sec: 18872.01

Transfer/sec: 2.61MB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 13.16ms 5.18ms 97.43ms 83.24%

Req/Sec 619.59 89.39 2.35k 93.61%

Latency Distribution

50% 12.60ms

75% 14.87ms

90% 17.74ms

99% 32.79ms

197897 requests in 10.10s, 27.18MB read

Requests/sec: 19592.80

Transfer/sec: 2.69MB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 4.80ms 2.23ms 37.87ms 87.65%

Req/Sec 1.73k 288.16 3.52k 77.67%

Latency Distribution

50% 4.84ms

75% 4.97ms

90% 5.55ms

99% 15.63ms

553516 requests in 10.10s, 52.26MB read

Non-2xx or 3xx responses: 553516

Requests/sec: 54803.01

Transfer/sec: 5.17MB

Freya on Async (62248 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 26.65ms 6.29ms 168.23ms 84.29%

Req/Sec 301.76 55.99 1.16k 89.75%

Latency Distribution

50% 26.23ms

75% 29.35ms

90% 32.72ms

99% 42.55ms

96496 requests in 10.10s, 13.34MB read

Requests/sec: 9554.67

Transfer/sec: 1.32MB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 30.03ms 5.36ms 72.51ms 83.52%

Req/Sec 267.10 68.93 1.97k 99.34%

Latency Distribution

50% 29.00ms

75% 33.01ms

90% 36.28ms

99% 43.20ms

85320 requests in 10.10s, 11.72MB read

Requests/sec: 8447.52

Transfer/sec: 1.16MB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 9.28ms 3.75ms 48.93ms 75.85%

Req/Sec 0.87k 278.22 15.93k 99.78%

Latency Distribution

50% 9.45ms

75% 11.22ms

90% 12.84ms

99% 20.40ms

278273 requests in 10.10s, 26.27MB read

Non-2xx or 3xx responses: 278273

Requests/sec: 27553.21

Transfer/sec: 2.60MB

ASP.NET MVC Core (64224 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 5.98ms 4.00ms 208.74ms 89.42%

Req/Sec 1.41k 149.63 3.67k 91.66%

Latency Distribution

50% 5.14ms

75% 6.75ms

90% 9.46ms

99% 18.60ms

451523 requests in 10.10s, 70.62MB read

Requests/sec: 44712.47

Transfer/sec: 6.99MB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 7.63ms 3.91ms 66.78ms 81.60%

Req/Sec 1.08k 174.78 4.11k 86.03%

Latency Distribution

50% 7.22ms

75% 8.80ms

90% 11.16ms

99% 20.18ms

345469 requests in 10.10s, 53.70MB read

Requests/sec: 34207.83

Transfer/sec: 5.32MB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 1.97ms 1.11ms 31.26ms 91.89%

Req/Sec 4.24k 521.80 10.15k 82.25%

Latency Distribution

50% 1.75ms

75% 2.03ms

90% 2.68ms

99% 6.24ms

1355323 requests in 10.10s, 127.96MB read

Non-2xx or 3xx responses: 1355323

Requests/sec: 134199.78

Transfer/sec: 12.67MB

Suave (387084 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 132.96ms 130.56ms 1.98s 96.61%

Req/Sec 60.31 46.91 480.00 83.42%

Latency Distribution

50% 118.66ms

75% 159.47ms

90% 193.32ms

99% 766.04ms

13654 requests in 10.10s, 1.91MB read

Socket errors: connect 0, read 0, write 0, timeout 120

Requests/sec: 1352.52

Transfer/sec: 194.16KB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 135.31ms 141.46ms 1.99s 97.48%

Req/Sec 61.29 50.84 590.00 82.00%

Latency Distribution

50% 119.05ms

75% 169.17ms

90% 201.58ms

99% 869.23ms

14351 requests in 10.10s, 2.00MB read

Socket errors: connect 0, read 0, write 0, timeout 118

Requests/sec: 1421.42

Transfer/sec: 202.66KB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 0.00us 0.00us 0.00us -nan%

Req/Sec 0.00 0.00 0.00 -nan%

Latency Distribution

50% 0.00us

75% 0.00us

90% 0.00us

99% 0.00us

0 requests in 10.10s, 0.00B read

Socket errors: connect 0, read 14341, write 0, timeout 0

Requests/sec: 0.00

Transfer/sec: 0.00B

(and then failed to release its socket on shutdown)

=======

Quick test using the demo hello world with authentication and CORS:

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 16.36ms 2.52ms 58.71ms 84.88%

Req/Sec 491.33 37.33 0.86k 81.04%

Latency Distribution

50% 15.88ms

75% 16.66ms

90% 19.38ms

99% 23.84ms

157468 requests in 10.10s, 22.08MB read

Requests/sec: 15589.88

Transfer/sec: 2.19MB

70 of 78

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/hello/fred

OS: Debian 8

GCE 4 vCPU, 4GB

Published self-contained

@neoeinstein�https://goo.gl/L77RHj

Results were similar when needing to parse a segment out of the path

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/hello

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/hello/fred

wrk -c 256 -t 32 -d 10 --latency http://104.155.85.181:8080/missing

Freya on Hopac (291656 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 13.53ms 2.80ms 105.62ms 87.11%

Req/Sec 595.74 52.12 1.26k 91.01%

Latency Distribution

50% 13.16ms

75% 13.63ms

90% 15.59ms

99% 22.96ms

190610 requests in 10.10s, 26.36MB read

Requests/sec: 18872.01

Transfer/sec: 2.61MB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 13.16ms 5.18ms 97.43ms 83.24%

Req/Sec 619.59 89.39 2.35k 93.61%

Latency Distribution

50% 12.60ms

75% 14.87ms

90% 17.74ms

99% 32.79ms

197897 requests in 10.10s, 27.18MB read

Requests/sec: 19592.80

Transfer/sec: 2.69MB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 4.80ms 2.23ms 37.87ms 87.65%

Req/Sec 1.73k 288.16 3.52k 77.67%

Latency Distribution

50% 4.84ms

75% 4.97ms

90% 5.55ms

99% 15.63ms

553516 requests in 10.10s, 52.26MB read

Non-2xx or 3xx responses: 553516

Requests/sec: 54803.01

Transfer/sec: 5.17MB

Freya on Async (62248 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 26.65ms 6.29ms 168.23ms 84.29%

Req/Sec 301.76 55.99 1.16k 89.75%

Latency Distribution

50% 26.23ms

75% 29.35ms

90% 32.72ms

99% 42.55ms

96496 requests in 10.10s, 13.34MB read

Requests/sec: 9554.67

Transfer/sec: 1.32MB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 30.03ms 5.36ms 72.51ms 83.52%

Req/Sec 267.10 68.93 1.97k 99.34%

Latency Distribution

50% 29.00ms

75% 33.01ms

90% 36.28ms

99% 43.20ms

85320 requests in 10.10s, 11.72MB read

Requests/sec: 8447.52

Transfer/sec: 1.16MB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 9.28ms 3.75ms 48.93ms 75.85%

Req/Sec 0.87k 278.22 15.93k 99.78%

Latency Distribution

50% 9.45ms

75% 11.22ms

90% 12.84ms

99% 20.40ms

278273 requests in 10.10s, 26.27MB read

Non-2xx or 3xx responses: 278273

Requests/sec: 27553.21

Transfer/sec: 2.60MB

ASP.NET MVC Core (64224 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 5.98ms 4.00ms 208.74ms 89.42%

Req/Sec 1.41k 149.63 3.67k 91.66%

Latency Distribution

50% 5.14ms

75% 6.75ms

90% 9.46ms

99% 18.60ms

451523 requests in 10.10s, 70.62MB read

Requests/sec: 44712.47

Transfer/sec: 6.99MB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 7.63ms 3.91ms 66.78ms 81.60%

Req/Sec 1.08k 174.78 4.11k 86.03%

Latency Distribution

50% 7.22ms

75% 8.80ms

90% 11.16ms

99% 20.18ms

345469 requests in 10.10s, 53.70MB read

Requests/sec: 34207.83

Transfer/sec: 5.32MB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 1.97ms 1.11ms 31.26ms 91.89%

Req/Sec 4.24k 521.80 10.15k 82.25%

Latency Distribution

50% 1.75ms

75% 2.03ms

90% 2.68ms

99% 6.24ms

1355323 requests in 10.10s, 127.96MB read

Non-2xx or 3xx responses: 1355323

Requests/sec: 134199.78

Transfer/sec: 12.67MB

Suave (387084 kiB)

Running 10s test @ http://104.155.85.181:8080/hello

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 132.96ms 130.56ms 1.98s 96.61%

Req/Sec 60.31 46.91 480.00 83.42%

Latency Distribution

50% 118.66ms

75% 159.47ms

90% 193.32ms

99% 766.04ms

13654 requests in 10.10s, 1.91MB read

Socket errors: connect 0, read 0, write 0, timeout 120

Requests/sec: 1352.52

Transfer/sec: 194.16KB

Running 10s test @ http://104.155.85.181:8080/hello/fred

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 135.31ms 141.46ms 1.99s 97.48%

Req/Sec 61.29 50.84 590.00 82.00%

Latency Distribution

50% 119.05ms

75% 169.17ms

90% 201.58ms

99% 869.23ms

14351 requests in 10.10s, 2.00MB read

Socket errors: connect 0, read 0, write 0, timeout 118

Requests/sec: 1421.42

Transfer/sec: 202.66KB

Running 10s test @ http://104.155.85.181:8080/missing

32 threads and 256 connections

Thread Stats Avg Stdev Max +/- Stdev

Latency 0.00us 0.00us 0.00us -nan%

Req/Sec 0.00 0.00 0.00 -nan%

Latency Distribution

50% 0.00us

75% 0.00us

90% 0.00us

99% 0.00us

0 requests in 10.10s, 0.00B read

Socket errors: connect 0, read 14341, write 0, timeout 0

Requests/sec: 0.00

Transfer/sec: 0.00B

(and then failed to release its socket on shutdown)

71 of 78

OS: Debian 8

GCE 4 vCPU, 4GB

Published self-contained

5.98

@neoeinstein�https://goo.gl/L77RHj

72 of 78

OS: Debian 8

GCE 4 vCPU, 4GB

Published self-contained

@neoeinstein�https://goo.gl/L77RHj

73 of 78

Functional

Web Service

@neoeinstein�https://goo.gl/L77RHj

74 of 78

.NET Core

@neoeinstein�https://goo.gl/L77RHj

75 of 78

@neoeinstein�https://goo.gl/L77RHj

76 of 78

Kestrel

OWIN

Hopac

Async

@neoeinstein�https://goo.gl/L77RHj

77 of 78

@neoeinstein�https://goo.gl/L77RHj

78 of 78

freya.io

https://goo.gl/L77RHj

@neoeinstein�https://goo.gl/L77RHj