Akka（37）： Http：客户端操作模式

2024-04-09 04:48
文章标签 模式 操作 http 客户端 37 akka

本文主要是介绍Akka（37）： Http：客户端操作模式，希望对大家解决编程问题提供一定的参考价值，需要的开发者们随着小编来一起学习吧！

   Akka-http的客户端连接模式除Connection-Level和Host-Level之外还有一种非常便利的模式：Request-Level-Api。这种模式免除了连接Connection的概念，任何时候可以直接调用singleRequest来与服务端沟通。下面我们用几个例子来示范singleRequest的用法：

  (for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri="http://localhost:8011/message"))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")}.andThen {case _ => sys.terminate()}

这是一个GET操作：用Http().singleRequest直接把HttpRequest发送给服务端uri并获取返回的HttpResponse。我们看到，整组函数的返回类型都是Future[?]，所以用for-comprehension来把所有实际运算包嵌在Future运算模式内（context)。下面这个例子是客户端上传数据示范： 

  (for {entity <- Marshal("Wata hell you doing?").to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/message",entity=entity))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")}.andThen {case _ => sys.terminate()}

以上是个PUT操作。我们需要先构建数据载体HttpEntity。格式转换函数Marshal也返回Future[HttpEntity]，所以也可以包含在for语句内。关注一下这个andThen，它可以连接一串多个monadic运算，在不影响上游运算结果的情况下实现一些副作用计算。

值得注意的是上面这两个例子虽然表现形式很简洁，但我们无法对数据转换过程中的异常及response的状态码等进行监控。所以我们应该把整个过程拆分成两部分：先获取response，再具体处理response,包括核对状态，处理数据等：

  case class Item(id: Int, name: String, price: Double)def getItem(itemId: Int): Future[HttpResponse] = for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responsedef extractEntity[T](futResp: Future[HttpResponse])(implicit um: Unmarshaller[ResponseEntity,T]) = {futResp.andThen {case Success(HttpResponse(StatusCodes.OK, _, entity, _)) =>Unmarshal(entity).to[T].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case Success(_) => println("Exception in response!")case Failure(err) => println(s"Response Failed: ${err.getMessage}")}}extractEntity[Item](getItem(13))

现在这个extractEntity[Item](getItem(13))可以实现全过程的监控管理了。用同样的模式实现PUT操作： 

  def putItem(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItem(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}

当然，我们还是使用了前面几篇讨论里的Marshalling方式来进行数据格式的自动转换： 

import de.heikoseeberger.akkahttpjson4s.Json4sSupport
import org.json4s.jackson
...
trait JsonCodec extends Json4sSupport {import org.json4s.DefaultFormatsimport org.json4s.ext.JodaTimeSerializersimplicit val serilizer = jackson.Serializationimplicit val formats = DefaultFormats ++ JodaTimeSerializers.all
}
object JsConverters extends JsonCodec
...import JsConverters._implicit val jsonStreamingSupport = EntityStreamingSupport.json().withParallelMarshalling(parallelism = 8, unordered = false)

如果我们需要对数据交换过程进行更细致的管控，用Host-Level-Api会更加适合。下面我们就针对Host-Level-Api构建一个客户端的工具库： 

class PooledClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest, Int), (Try[HttpResponse], Int), Http.HostConnectionPool] =Http().cachedHostConnectionPool[Int](host = host, port = port, settings = poolSettings)
//单一requestdef requestSingleResponse(req: HttpRequest): Future[HttpResponse] = {Source.single(req -> 1).via(cnnPool).runWith(Sink.head).flatMap {case (Success(resp), _) => Future.successful(resp)case (Failure(fail), _) => Future.failed(fail)}}
//组串requestdef orderedResponses(reqs: Iterable[HttpRequest]): Future[Iterable[HttpResponse]] = {Source(reqs.zipWithIndex.toMap).via(cnnPool).runFold(SortedMap[Int, Future[HttpResponse]]()) {case (m, (Success(r), idx)) => m + (idx -> Future.successful(r))case (m, (Failure(f), idx)) => m + (idx -> Future.failed(f))}.flatMap { m => Future.sequence(m.values) }}
}

下面是一种比较安全的模式：使用了queue来暂存request从而解决因发送方与接收方速率不同所产生的问题： 

class QueuedRequestsClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(qsize: Int = 10, overflowStrategy: OverflowStrategy = OverflowStrategy.dropNew)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest,Promise[HttpResponse]),(Try[HttpResponse],Promise[HttpResponse]),Http.HostConnectionPool] =Http().cachedHostConnectionPool[Promise[HttpResponse]](host=host,port=port,settings=poolSettings)val queue =Source.queue[(HttpRequest, Promise[HttpResponse])](qsize, overflowStrategy).via(cnnPool).to(Sink.foreach({case ((Success(resp), p)) => p.success(resp)case ((Failure(e), p))    => p.failure(e)})).run()def queueRequest(request: HttpRequest): Future[HttpResponse] = {val responsePromise = Promise[HttpResponse]()queue.offer(request -> responsePromise).flatMap {case QueueOfferResult.Enqueued    => responsePromise.futurecase QueueOfferResult.Dropped     => Future.failed(new RuntimeException("Queue overflowed. Try again later."))case QueueOfferResult.Failure(ex) => Future.failed(ex)case QueueOfferResult.QueueClosed => Future.failed(new RuntimeException("Queue was closed (pool shut down) while running the request. Try again later."))}}
}

下面是这些工具函数的具体使用示范： 

  val settings = ConnectionPoolSettings(sys).withMaxConnections(8).withMaxOpenRequests(8).withMaxRetries(3).withPipeliningLimit(4)val pooledClient = new PooledClient("localhost",8011,settings)def getItemByPool(itemId: Int): Future[HttpResponse] = for {response <- pooledClient.requestSingleResponse(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responseextractEntity[Item](getItemByPool(13))def getItemsByPool(itemIds: List[Int]): Future[Iterable[HttpResponse]] = {val reqs = itemIds.map { id =>HttpRequest(method = HttpMethods.GET, uri = s"http://localhost:8011/item/$id")}val rets = (for {responses <- pooledClient.orderedResponses(reqs)} yield responses)rets}val futResps = getItemsByPool(List(3,5,7))futResps.andThen {case Success(listOfResps) => {listOfResps.foreach { r =>r match {case HttpResponse(StatusCodes.OK, _, entity, _) =>Unmarshal(entity).to[Item].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case _ => println("Exception in response!")}}}case _ => println("Failed to get list of responses!")}val queuedClient = new QueuedRequestsClient("localhost",8011,settings)()def putItemByQueue(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- queuedClient.queueRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItemByQueue(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}

下面是本次讨论的示范源代码：

服务端代码：

import akka.actor._
import akka.stream._
import akka.http.scaladsl.Http
import akka.http.scaladsl.server.Directives._import de.heikoseeberger.akkahttpjson4s.Json4sSupport
import org.json4s.jackson
trait JsonCodec extends Json4sSupport {import org.json4s.DefaultFormatsimport org.json4s.ext.JodaTimeSerializersimplicit val serilizer = jackson.Serializationimplicit val formats = DefaultFormats ++ JodaTimeSerializers.all
}
object JsConverters extends JsonCodecobject TestServer extends App with JsonCodec {implicit val httpSys = ActorSystem("httpSystem")implicit val httpMat = ActorMaterializer()implicit val httpEC = httpSys.dispatcherimport JsConverters._case class Item(id: Int, name: String, price: Double)val messages = path("message") {get {complete("hello, how are you?")} ~put {entity(as[String]) {msg =>complete(msg)}}}val items =(path("item" / IntNumber) & get) { id =>get {complete(Item(id, s"item#$id", id * 2.0))}} ~(path("item") & put) {entity(as[Item]) {item =>complete(item)}}val route = messages ~ itemsval (host, port) = ("localhost", 8011)val bindingFuture = Http().bindAndHandle(route,host,port)println(s"Server running at $host $port. Press any key to exit ...")scala.io.StdIn.readLine()bindingFuture.flatMap(_.unbind()).onComplete(_ => httpSys.terminate())}

客户端源代码： 

import akka.actor._
import akka.http.scaladsl.settings.ConnectionPoolSettings
import akka.stream._
import akka.stream.scaladsl._
import akka.http.scaladsl.Http
import akka.http.scaladsl.model._import scala.util._
import de.heikoseeberger.akkahttpjson4s.Json4sSupport
import org.json4s.jacksonimport scala.concurrent._
import akka.http.scaladsl.unmarshalling.Unmarshal
import akka.http.scaladsl.unmarshalling._
import akka.http.scaladsl.marshalling.Marshalimport scala.collection.SortedMap
import akka.http.scaladsl.common._trait JsonCodec extends Json4sSupport {import org.json4s.DefaultFormatsimport org.json4s.ext.JodaTimeSerializersimplicit val serilizer = jackson.Serializationimplicit val formats = DefaultFormats ++ JodaTimeSerializers.all
}
object JsConverters extends JsonCodecclass PooledClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest, Int), (Try[HttpResponse], Int), Http.HostConnectionPool] =Http().cachedHostConnectionPool[Int](host = host, port = port, settings = poolSettings)def requestSingleResponse(req: HttpRequest): Future[HttpResponse] = {Source.single(req -> 1).via(cnnPool).runWith(Sink.head).flatMap {case (Success(resp), _) => Future.successful(resp)case (Failure(fail), _) => Future.failed(fail)}}def orderedResponses(reqs: Iterable[HttpRequest]): Future[Iterable[HttpResponse]] = {Source(reqs.zipWithIndex.toMap).via(cnnPool).runFold(SortedMap[Int, Future[HttpResponse]]()) {case (m, (Success(r), idx)) => m + (idx -> Future.successful(r))case (m, (Failure(f), idx)) => m + (idx -> Future.failed(f))}.flatMap { m => Future.sequence(m.values) }}
}
class QueuedRequestsClient(host: String, port: Int, poolSettings: ConnectionPoolSettings)(qsize: Int = 10, overflowStrategy: OverflowStrategy = OverflowStrategy.dropNew)(implicit sys: ActorSystem, mat: ActorMaterializer) {import sys.dispatcherprivate val cnnPool: Flow[(HttpRequest,Promise[HttpResponse]),(Try[HttpResponse],Promise[HttpResponse]),Http.HostConnectionPool] =Http().cachedHostConnectionPool[Promise[HttpResponse]](host=host,port=port,settings=poolSettings)val queue =Source.queue[(HttpRequest, Promise[HttpResponse])](qsize, overflowStrategy).via(cnnPool).to(Sink.foreach({case ((Success(resp), p)) => p.success(resp)case ((Failure(e), p))    => p.failure(e)})).run()def queueRequest(request: HttpRequest): Future[HttpResponse] = {val responsePromise = Promise[HttpResponse]()queue.offer(request -> responsePromise).flatMap {case QueueOfferResult.Enqueued    => responsePromise.futurecase QueueOfferResult.Dropped     => Future.failed(new RuntimeException("Queue overflowed. Try again later."))case QueueOfferResult.Failure(ex) => Future.failed(ex)case QueueOfferResult.QueueClosed => Future.failed(new RuntimeException("Queue was closed (pool shut down) while running the request. Try again later."))}}
}
object ClientRequesting extends App {import JsConverters._implicit val sys = ActorSystem("sysClient")implicit val mat = ActorMaterializer()implicit val ec = sys.dispatcherimplicit val jsonStreamingSupport = EntityStreamingSupport.json().withParallelMarshalling(parallelism = 8, unordered = false)case class Item(id: Int, name: String, price: Double)def extractEntity[T](futResp: Future[HttpResponse])(implicit um: Unmarshaller[ResponseEntity,T]) = {futResp.andThen {case Success(HttpResponse(StatusCodes.OK, _, entity, _)) =>Unmarshal(entity).to[T].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case Success(_) => println("Exception in response!")case Failure(err) => println(s"Response Failed: ${err.getMessage}")}}(for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri="http://localhost:8011/message"))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")}  //.andThen {case _ => sys.terminate()}(for {entity <- Marshal("Wata hell you doing?").to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/message",entity=entity))message <- Unmarshal(response.entity).to[String]} yield message).andThen {case Success(msg) => println(s"Received message: $msg")case Failure(err) => println(s"Error: ${err.getMessage}")} //.andThen {case _ => sys.terminate()}def getItem(itemId: Int): Future[HttpResponse] = for {response <- Http().singleRequest(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responseextractEntity[Item](getItem(13))def putItem(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- Http().singleRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItem(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}val settings = ConnectionPoolSettings(sys).withMaxConnections(8).withMaxOpenRequests(8).withMaxRetries(3).withPipeliningLimit(4)val pooledClient = new PooledClient("localhost",8011,settings)def getItemByPool(itemId: Int): Future[HttpResponse] = for {response <- pooledClient.requestSingleResponse(HttpRequest(method=HttpMethods.GET,uri = s"http://localhost:8011/item/$itemId"))} yield responseextractEntity[Item](getItemByPool(13))def getItemsByPool(itemIds: List[Int]): Future[Iterable[HttpResponse]] = {val reqs = itemIds.map { id =>HttpRequest(method = HttpMethods.GET, uri = s"http://localhost:8011/item/$id")}val rets = (for {responses <- pooledClient.orderedResponses(reqs)} yield responses)rets}val futResps = getItemsByPool(List(3,5,7))futResps.andThen {case Success(listOfResps) => {listOfResps.foreach { r =>r match {case HttpResponse(StatusCodes.OK, _, entity, _) =>Unmarshal(entity).to[Item].onComplete {case Success(t) => println(s"Got response entity: ${t}")case Failure(e) => println(s"Unmarshalling failed: ${e.getMessage}")}case _ => println("Exception in response!")}}}case _ => println("Failed to get list of responses!")}val queuedClient = new QueuedRequestsClient("localhost",8011,settings)()def putItemByQueue(item: Item): Future[HttpResponse] =for {reqEntity <- Marshal(item).to[RequestEntity]response <- queuedClient.queueRequest(HttpRequest(method=HttpMethods.PUT,uri="http://localhost:8011/item",entity=reqEntity))} yield responseextractEntity[Item](putItemByQueue(Item(23,"Item#23", 46.0))).andThen { case _ => sys.terminate()}}






这篇关于Akka（37）： Http：客户端操作模式的文章就介绍到这儿，希望我们推荐的文章对编程师们有所帮助！


http://www.chinasem.cn/article/887205。

相关文章

使用Java填充Word模板的操作指南

使用Java填充Word模板的操作指南

《使用Java填充Word模板的操作指南》本文介绍了Java填充Word模板的实现方法,包括文本、列表和复选框的填充,首先通过Word域功能设置模板变量,然后使用poi-tl、aspose-words... 目录前言一、设置word模板普通字段列表字段复选框二、代码1. 引入POM2. 模板放入项目3.代码
阅读更多...
利用Python操作Word文档页码的实际应用

利用Python操作Word文档页码的实际应用

《利用Python操作Word文档页码的实际应用》在撰写长篇文档时,经常需要将文档分成多个节,每个节都需要单独的页码,下面：本文主要介绍利用Python操作Word文档页码的相关资料,文中通过代码... 目录需求：文档详情：要求：该程序的功能是：总结需求：一次性处理24个文档的页码。文档详情：1、每个
阅读更多...
Python内存管理机制之垃圾回收与引用计数操作全过程

Python内存管理机制之垃圾回收与引用计数操作全过程

《Python内存管理机制之垃圾回收与引用计数操作全过程》SQLAlchemy是Python中最流行的ORM（对象关系映射）框架之一,它提供了高效且灵活的数据库操作方式,本文将介绍如何使用SQLAlc... 目录安装核心概念连接数据库定义数据模型创建数据库表基本CRUD操作创建数据读取数据更新数据删除数据查
阅读更多...
Go语言中json操作的实现

Go语言中json操作的实现

《Go语言中json操作的实现》本文主要介绍了Go语言中的json操作的实现,文中通过示例代码介绍的非常详细,对大家的学习或者工作具有一定的参考学习价值,需要的朋友们下面随着小编来一起学习学习吧... 目录 一、jsOChina编程N 与 Go 类型对应关系️ 二、基本操作：编码与解码 三、结构体标签（Struc
阅读更多...
Java 字符串操作之contains 和 substring 方法最佳实践与常见问题

Java 字符串操作之contains 和 substring 方法最佳实践与常见问题

《Java字符串操作之contains和substring方法最佳实践与常见问题》本文给大家详细介绍Java字符串操作之contains和substring方法最佳实践与常见问题,本文结合实例... 目录一、contains 方法详解1. 方法定义与语法2. 底层实现原理3. 使用示例4. 注意事项二、su
阅读更多...
Java Stream流与使用操作指南

Java Stream流与使用操作指南

《JavaStream流与使用操作指南》Stream不是数据结构,而是一种高级的数据处理工具,允许你以声明式的方式处理数据集合,类似于SQL语句操作数据库,本文给大家介绍JavaStream流与使用... 目录一、什么是stream流二、创建stream流1.单列集合创建stream流2.双列集合创建str
阅读更多...
Python正则表达式匹配和替换的操作指南

Python正则表达式匹配和替换的操作指南

《Python正则表达式匹配和替换的操作指南》正则表达式是处理文本的强大工具,Python通过re模块提供了完整的正则表达式功能,本文将通过代码示例详细介绍Python中的正则匹配和替换操作,需要的朋... 目录基础语法导入re模块基本元字符常用匹配方法1. re.match() - 从字符串开头匹配2.
阅读更多...
Nginx部署HTTP/3的实现步骤

Nginx部署HTTP/3的实现步骤

《Nginx部署HTTP/3的实现步骤》本文介绍了在Nginx中部署HTTP/3的详细步骤,文中通过示例代码介绍的非常详细,对大家的学习或者工作具有一定的参考学习价值,需要的朋友们下面随着小编来一起学... 目录前提条件第一步：安装必要的依赖库第二步：获取并构建 BoringSSL第三步：获取 Nginx
阅读更多...
Java实现在Word文档中添加文本水印和图片水印的操作指南

Java实现在Word文档中添加文本水印和图片水印的操作指南

《Java实现在Word文档中添加文本水印和图片水印的操作指南》在当今数字时代,文档的自动化处理与安全防护变得尤为重要,无论是为了保护版权、推广品牌,还是为了在文档中加入特定的标识,为Word文档添加... 目录引言Spire.Doc for Java：高效Word文档处理的利器代码实战：使用Java为Wo
阅读更多...
HTTP 与 SpringBoot 参数提交与接收协议方式

HTTP 与 SpringBoot 参数提交与接收协议方式

《HTTP与SpringBoot参数提交与接收协议方式》HTTP参数提交方式包括URL查询、表单、JSON/XML、路径变量、头部、Cookie、GraphQL、WebSocket和SSE,依据... 目录HTTP 协议支持多种参数提交方式，主要取决于请求方法(Method)和内容类型(Content-Ty
阅读更多...

Copyright China编程 23002807@qq.com

沪ICP备2023033072号-2