Jindo DistCp场景化使用指导
hadoop jar jindo-distcp-<version>.jar-src/data/incoming/hourly_table-dest oss:/destBucket/hourly_table-ossKey yourkey-ossSecret yoursecret-ossEndPoint oss-cn-hangzhou.aliyuncs.com --policy archive-parallelism 20 当通过低频...
Jindo DistCp场景化使用指导
hadoop jar jindo-distcp-<version>.jar-src/data/incoming/hourly_table-dest oss:/destBucket/hourly_table-ossKey yourkey-ossSecret yoursecret-ossEndPoint oss-cn-hangzhou.aliyuncs.com --policy archive-parallelism 20 当通过低频...
Jindo DistCp场景化使用指导
hadoop jar jindo-distcp-<version>.jar-src/data/incoming/hourly_table-dest oss:/destBucket/hourly_table-ossKey yourkey-ossSecret yoursecret-ossEndPoint oss-cn-hangzhou.aliyuncs.com --policy archive-parallelism 20 当通过低频...
Jindo DistCp场景化使用指导
hadoop jar jindo-distcp-<version>.jar-src/data/incoming/hourly_table-dest oss:/destBucket/hourly_table-ossKey yourkey-ossSecret yoursecret-ossEndPoint oss-cn-hangzhou.aliyuncs.com --policy archive-parallelism 20 当通过低频...
迁移Group上云
java-jar kafka-migration-assessment.jar ConsumerGroupMigrationFromTopic-propertiesPath/usr/local/kafka_2.12-2.4.0/config/kafka.properties-destAk<yourAccessKeyId>-destSk<yourAccessKeySecret>-destRegionId<yourRegionId>-...
添加备份网关
java-archive]Saving to:‘aliyunDBSAgentInstaller.jar’100%[=>]247,955,671 17.4MB/s in 13s 2023-08-25 15:44:49(17.6 MB/s)-‘aliyunDBSAgentInstaller.jar’saved[247955671/247955671]选择安装语言。输入0表示选择中文，1表示选项...
Jindo DistCp使用说明
ossKey=VALUE-Specify your oss key if needed-ossSecret=VALUE-Specify your oss secret if needed-ossEndPoint=VALUE-Specify your oss endPoint if needed-policy=VALUE-Specify your oss storage policy-cleanUpPending-clean up the ...
Jindo DistCp使用说明
ossKey=VALUE-Specify your oss key if needed-ossSecret=VALUE-Specify your oss secret if needed-ossEndPoint=VALUE-Specify your oss endPoint if needed-policy=VALUE-Specify your oss storage policy-cleanUpPending-clean up the ...
Jindo DistCp使用说明
ossKey=VALUE-Specify your oss key if needed-ossSecret=VALUE-Specify your oss secret if needed-ossEndPoint=VALUE-Specify your oss endPoint if needed-policy=VALUE-Specify your oss storage policy-cleanUpPending-clean up the ...
Jindo DistCp使用说明
ossKey=VALUE-Specify your oss key if needed-ossSecret=VALUE-Specify your oss secret if needed-ossEndPoint=VALUE-Specify your oss endPoint if needed-policy=VALUE-Specify your oss storage policy-cleanUpPending-clean up the ...
开发和调试
commons-codec-1.3.jar commons-io-2.0.1.jar commons-lang-2.5.jar commons-logging-1.0.4.jar commons-logging-api-1.0.4.jar guava-14.0.jar json.jar log4j-1.2.15.jar slf4j-api-1.4.3.jar slf4j-log4j12-1.4.3.jar xmlenc-0.52.jar ...
单机部署
解压后的文件结构如下：ossimport├─bin│└─ossimport2.jar#包括Master、Worker、TaskTracker、Console四个模块的总jar├─conf│├─local_job.cfg#Job配置文件│└─sys.properties#系统运行参数配置文件├─console.bat#Windows命令...
alicloud_db_backup_policy
Provides an RDS instance backup policy resource and used to configure instance backup policy,see What is DB Backup Policy.->NOTE:Each DB instance has a backup policy and it will be set default values when destroying the ...
ossimport概述
分布式模式下文件结构如下：ossimport├─bin│├─console.jar#Console模块jar包│├─master.jar#Master模块jar包│├─tracker.jar#Tracker模块jar包│└─worker.jar#Worker模块jar包├─conf│├─job.cfg#Job配置文件模板│├─sys....
Python使用说明
使用文件传输工具（SSH Secure File Transfer Client），上传JAR包至Master节点的/usr/local 目录。解压下载文件并安装。登录Master节点，详情请参见 登录集群。创建Python 3的安装目录。sudo mkdir-p/usr/local/python3 解压缩下载文件。...
在服务网格环境下如何保持服务访问时的客户端源IP
upstream_local_address":"127.0.0.6:42169"：httpbin Envoy连接httpbin的local address（此时获得的源IP地址是 127.0.0.6）。upstream_host":"172.17.X.XXX:80"：httpbin Envoy访问的目标地址。开启TPROXY保持源IP 修改httpbin应用的...
在服务网格环境下如何保持服务访问时的客户端源IP
upstream_local_address":"127.0.0.6:42169"：httpbin Envoy连接httpbin的local address（此时获得的源IP地址是 127.0.0.6）。upstream_host":"172.17.X.XXX:80"：httpbin Envoy访问的目标地址。开启TPROXY保持源IP 修改httpbin应用的...
alicloud_cloud_sso_access_configuration
policies The permission_policies supports the following:permission_policy_document-(Optional,Sensitive)The Content of Policy.permission_policy_name-(Required)The Policy Name of policy.The name of the resource.permission_...
使用Spark访问
export HADOOP_HOME=usr/local/hadoop-2.7.3 export HADOOP_CLASSPATH=usr/local/hadoop-2.7.3/etc/hadoop:/usr/local/hadoop-2.7.3/share/hadoop/common/lib/*:/usr/local/hadoop-2.7.3/share/hadoop/common/*:/usr/local/hadoop-2.7.3/...
alicloud_ecd_desktops
site_name="your_office_site_name"} data"alicloud_ecd_bundles""default"{ bundle_type="SYSTEM"} resource"alicloud_ecd_policy_group""default"{ policy_group_name="your_policy_group_name"clipboard="readwrite"local_drive="read...
alicloud_ecd_images
site_name="your_simple_office_site_name"} data"alicloud_ecd_bundles""default"{ bundle_type="SYSTEM"} resource"alicloud_ecd_policy_group""default"{ policy_group_name="your_policy_group_name"clipboard="readwrite"local_...
alicloud_ecd_commands
office_site_name"} data"alicloud_ecd_bundles""default"{ bundle_type="SYSTEM"name_regex="windows"} resource"alicloud_ecd_policy_group""default"{ policy_group_name="your_policy_group_name"clipboard="readwrite"local_...
SubmitSparkJob
ConfigJson String 是 {"name":"SparkPi","file":"local:/tmp/spark-examples.jar","className":"org.apache.spark.examples.SparkPi","args":["100"],"conf":{"spark.driver.resourceSpec":"medium","spark.executor.instances":5,"spark....
GetJobDetail
\"medium\",\"spark.executor.instances\":5,\"spark.executor.resourceSpec\":\"medium\"},\"file\":\"local:/tmp/spark-examples.jar\"}"},"RequestId":"5F10AB6E-8984-4E32-B821-4E1512711B8C"} 错误码 访问 错误中心 查看更多错误码。
alicloud_ecd_image
group_name=var.name clipboard="read"local_drive="read"usb_redirect="off"watermark="off"authorize_access_policy_rules { description=var.name cidr_ip="1.2.3.45/24"} authorize_security_policy_rules { type="inflow"policy=...
alicloud_ecd_command
ecd_policy_group""default"{ policy_group_name=var.name clipboard="read"local_drive="read"usb_redirect="off"watermark="off"authorize_access_policy_rules { description=var.name cidr_ip="1.2.3.45/24"} authorize_security_...
alicloud_ecd_snapshot
ecd_policy_group""default"{ policy_group_name=var.name clipboard="read"local_drive="read"usb_redirect="off"watermark="off"authorize_access_policy_rules { description=var.name cidr_ip="1.2.3.45/24"} authorize_security_...
alicloud_ecd_desktop
group_name=var.name clipboard="read"local_drive="read"usb_redirect="off"watermark="off"authorize_access_policy_rules { description=var.name cidr_ip="1.2.3.45/24"} authorize_security_policy_rules { type="inflow"policy=...
资源操作
Resource Name Owner Creation Time Last Modified Time Type Last Updator Resource Size Source comment getaddr.jar ALIYUN$2020-06-18 15:47:28 2020-06-18 15:47:28 jar 1353716 cloudopenapi ip.dat ALIYUN$2020-06-18 15:49:46 2020...
接入应用防护
java-javaagent:/usr/local/aegis/rasp/apps/{appId}/rasp.jar 例如，您在启动Spring Boot进程时修改前的命令为：java-jar app.jar 需要安装RASP探针时启动Spring Boot进程执行的命令为：java-javaagent:/usr/local/aegis/rasp/apps/{appId...
提交Spark作业
此时，需要您修改命令中的 local:/opt/spark/examples/spark-examples.jar 为您OSS上存放JAR包的真实路径，路径格式为 oss:/<yourBucketName>/<path>.jar。提交作业 方式一：使用CRD方式提交作业 通过kubectl连接Kubernetes集群，详情请...
GetJobAttemptLog
调用GetJobAttemptLog，获取对应...返回数据 名称 类型 示例值 描述 Data String local:/opt/spark/jars/offline-sql.jar,main_file+exec/usr/bin/tini-s-/jdk/jdk8/bin/java-cp '/opt/tools/exec-wrapper.jar:.:/opt/spark/jars/*' ...
alicloud_rds_instance_cross_backup_policy
Provides an RDS instance emote disaster recovery strategy policy resource and used to configure instance emote disaster recovery strategy policy.For information about RDS cross region backup settings and how to use them,......
快速使用EMR on ACK
此时，需要您修改命令中的 local:/opt/spark/examples/spark-examples.jar 为您OSS上存放JAR包的真实路径，路径格式为 oss:/<yourBucketName>/<path>.jar。准备工作 创建EMR on ACK集群前，需要在 容器服务管理控制台，进行以下操作：创建...
运行模式
MaxCompute Spark支持三种运行方式：Local模式、Cluster模式和DataWorks执行模式。Local模式 MaxCompute Spark支持用户以原生Spark Local模式进行作业调试。与Yarn Cluster模式类似，您首先需要做以下准备工作：准备MaxCompute项目以及对应...
alicloud_adb_backup_policy
Provides a ADB cluster backup policy resource and used to configure cluster backup policy.->NOTE:Available since v1.71.0.->Each DB cluster has a backup policy and it will be set default values when destroying the resource....
提交Flink作业
replicas:1 resource:memory:"2048m"cpu:1 taskManager:resource:memory:"2048m"cpu:1 job:jarURI:local:/opt/flink/examples/streaming/StateMachineExample.jar parallelism:2 upgradeMode:stateless 说明 本文以Flink 1.13版本为例，...
MapReduce作业提交
本文向您介绍如何使用Jar命令在MaxCompute客户端运行和提交MapReduce作业。MaxCompute客户端提供Jar命令用于运行MapReduce作业，举例如下。jar-conf \home\admin\myconf-resources a.txt,example.jar-classpath.\lib\example.jar:.\other_...
通过Annotation配置网络型负载均衡NLB
通过Service YAML文件中的...service.beta.kubernetes.io/alibaba-cloud-loadbalancer-address-type:"intranet"name:nginx namespace:default spec:externalTrafficPolicy:Local ports:name:tcp port:80 protocol:TCP targetPort:80-name:...
通过Annotation配置网络型负载均衡NLB
通过Service YAML文件中的...service.beta.kubernetes.io/alibaba-cloud-loadbalancer-address-type:"intranet"name:nginx namespace:default spec:externalTrafficPolicy:Local ports:name:tcp port:80 protocol:TCP targetPort:80-name:...
- 产品推荐
- 这些文档可能帮助您