AWS Notes

Issue #48 | 28 Nov - 04 Dec, re:Invent 2022 | Part #3 ▪️ Redshift      ▫️ auto-copy from Amazon S3      ▫️ centralized access control with Lake formation | Preview      ▫️ Dynamic Data Masking | Preview      ▫️ EMR integration for Apache Spark      ▫️ Informatica Data Loader integration      ▫️ integration for Apache Spark      ▫️ RA3 clusters Multi-AZ | Preview      ▫️ real-time streaming ingestion for KDS and MSK | GA      ▫️ speed up data warehouse migrations | Preview ▪️ Route 53 Application Recovery Controller zonal shift ▪️ S3 Access Points cross-account access permission delegation ▪️ S3 Multi-Region Access Points failover controls enable active-passive configurations and customer-initiated failovers ▪️ SageMaker Autopilot automate MLOps workflows with SageMaker Pipelines ▪️ SageMaker Data Wrangler      ▫️ built-in data preparation in notebooks      ▫️ now supports over 40 third-party applications as data sources      ▫️ real-time and batch inference and additional configs to processing jobs ▪️ SageMaker      ▫️ geospatial ML | Preview      ▫️ new ML governance tools      ▫️ shadow testing ▪️ SageMaker JumpStart share ML artifacts within your organization ▪️ SageMaker Studio      ▫️ automatic conversion of notebook code to production-ready jobs      ▫️ real time collaboration      ▫️ UI redesign ▪️ Security Lake new service | Preview ▪️ SimSpace Weaver new service | Preview ▪️ Step Functions large-scale parallel workflows ▪️ Supply Chain new service | Preview ▪️ Textract Analyze Lending ▪️ Transcribe real-time Call Analytics API ▪️ Verified Access new service | Preview ▪️ VPC Lattice new service | Preview ▪️ VPC Reachability Analyzer cross-account network reachability analysis ▪️ Wickr general availability

Issue #48 | 28 Nov - 04 Dec, re:Invent 2022 | Part #2 ▪️ EFS      ▫️ 1-Day Lifecycle Management Policy      ▫️ Elastic Throughput      ▫️ up to 60% read / 40% write lower latencies ▪️ Elastic Disaster Recovery cross-Region and cross-Availability Zone failback ▪️ Elastic Load Balancing new application availability ▪️ EventBridge Pipes point-to-point integration | GA ▪️ Firewall Manager FortiGate Cloud-Native Firewall ▪️ FSx for NetApp ONTAP simplifies access to Multi-AZ FS from on-premises and peered networks ▪️ FSx for NetApp ONTAP x2 maximum throughput capacity and SSD IOP/fs ▪️ FSx for OpenZFS new gen ▪️ GameLift customer-managed compute with GameLift Anywhere ▪️ Glue      ▫️ custom visual transforms      ▫️ Data Lake Frameworks (Apache Hudi, Apache Iceberg, Delta Lake)      ▫️ Ray new engine for Glue Preview      ▫️ Glue Data Quality | Preview      ▫️ Glue v4.0 with Spark 3.3.0 and Python 3.10 ▪️ GuardDuty RDS Protection | Preview ▪️ IoT Core new Device Location feature ▪️ IoT Device Management Jobs scheduling configuration ▪️ IoT MQTT5 General Availability ▪️ Kendra      ▫️ expanded language support for semantic search      ▫️ HTML documents tabular search ▪️ Kinesis Data Firehose data stream delivery to OpenSearch Serverless ▪️ KMS launches External Key Store ▪️ Lambda      ▫️ Amazon Inspector support      ▫️ SnapStart for Java functions ▪️ Local Zones Buenos Aires, Copenhagen, Helsinki, and Muscat | GA ▪️ Macie automated sensitive data discovery ▪️ Marketplace for containers direct deployment to EKS clusters ▪️ Network Manager Global Network real-time performance monitoring ▪️ Nitro Enclaves EKS and Kubernetes ▪️ Omics new service | GA ▪️ OpenSearch Serverless | Preview ▪️ Organizations delegated administrator ▪️ Outposts is now available in Qatar, Guatemala, and Trinidad & Tobago ▪️ Partners      ▫️ Glue Delivery      ▫️ Graviton Delivery      ▫️ MSK Delivery Managed Streaming      ▫️ SageMaker Ready Software Products ▪️ QuickSight      ▫️ Expanded API capabilities | GA      ▫️ Paginated Reports ▪️ QuickSight Q      ▫️ automated data preparation      ▫️ new "Why" and "forecast" questions ▪️ RDS      ▫️ Aurora PostgreSQL Trusted Language Extensions      ▫️ Blue/Green Deployments      ▫️ Optimized Reads up to 50% faster queries on RDS for MySQL      ▫️ Optimized Writes up to 2x higher write throughput at no additional cost

Issue #48 | 28 Nov - 04 Dec, re:Invent 2022 | Part #1 ▪️ AI Service Cards a new resource for responsible AI ▪️ Amazon Braket Algorithm Library access pre-built quantum algorithms ▪️ Amazon Verified Permissions permissions management and authorization service | Preview ▪️ AppConfig Agent easier feature flags and runtime configuration ▪️ AppFlow now supports over 50 Connectors ▪️ Application Composer visually design and build serverless applications | Preview ▪️ Application Migration Service application-centric migrations, wave planning, and more ▪️ Athena Spark support ▪️ Aurora zero-ETL integration with Redshift ▪️ AWS Marketplace streamline vendor risk assessments with Vendor Insights ▪️ Backup      ▫️ application-aware data protection for apps defined with CloudFormation      ▫️ centralized reporting      ▫️ delegation of organization-wide backup administration      ▫️ legal hold capability for extended data retention      ▫️ Redshift support ▪️ CloudTrail Lake AWS Config configuration items ▪️ CloudWatch      ▫️ cross-account observability      ▫️ Internet Monitor Preview ▪️ CloudWatch Logs detect and protect sensitive data-in-transit ▪️ CodeCatalyst new service | Preview ▪️ CodeWhisperer Enterprise administrative controls, simple sign-up, C#/Typescript ▪️ Comprehend      ▫️ classification and entity extraction directly from a variety of document formats      ▫️ semi-structured document processing ▪️ Compute Optimizer external metrics from observability partners ▪️ Config proactive compliance ▪️ Connect Contact Lens      ▫️ agent performance evaluation forms | Preview      ▫️ conversational analytics for chat ▪️ Connect      ▫️ forecasting, capacity planning, and scheduling | GA      ▫️ step-by-step guides in agent workspace | Preview ▪️ Control Tower      ▫️ account customization      ▫️ comprehensive controls management | Preview ▪️ Data Exchange      ▫️ for Amazon S3 | Preview      ▫️ for AWS Lake Formation | Preview ▪️ DMS Schema Conversion ▪️ DocumentDB Elastic Clusters | GA ▪️ EC2      ▫️ C6in instances      ▫️ C7gn instances      ▫️ Hpc6id instances      ▫️ Inf2 instances | Preview      ▫️ R7iz instances      ▫️ Elastic Network Adapter (ENA) Express      ▫️ M6in, M6idn, R6in, and R6idn network optimized instances      ▫️ Microsoft Office AMIs      ▫️ Spot Ready Software Products      ▫️ Torn Write Prevention for I4i instances, EBS, and RDS

Top Announcements of AWS re:Invent 2022: https://aws.amazon.com/blogs/aws/top-announcements-of-aws-reinvent-2022/ #reinvent

Доктор Вернер вдохновляет, как всегда! Очень рекомендую посмотреть, много интересных технологий вышло, и все разные, на любой вкус, как говорится! https://www.youtube.com/watch?v=RfvL_423a-I

kubectl scale --replicas=100

#пятничное

AWS re:Invent 2022 обзор анонсов часть 3: https://www.youtube.com/watch?v=pNL_uvH_BFU Присоединяйтесь к нам прямо сейчас! #reinvent

Amazon CodeCatalyst: https://codecatalyst.aws/explore Free Tier: ✅ 2000 Build Minutes ✅ 60 Dev Environment Hours ✅ 10 GB Source Storage ✅ 64 GB Dev Environment Storage

​​🆕 Amazon CodeCatalyst: https://aws.amazon.com/blogs/aws/announcing-amazon-codecatalyst-preview-a-unified-software-development-service/ Features in CodeCatalyst to address these challenges include: ▫️ Blueprints that set up the project’s resources—not just scaffolding for new projects, but also the resources needed to support software delivery and deployment. ▫️ On-demand cloud-based Dev Environments, to make it easy to replicate consistent development environments for you or your teams. ▫️ Issue management, enabling tracing of changes across commits, pull requests, and deployments. ▫️ Automated build and release (CI/CD) pipelines using flexible, managed build infrastructure. ▫️ Dashboards to surface a feed of project activities such as commits, pull requests, and test reporting. ▫️ The ability to invite others to collaborate on a project with just an email. ▫️ Unified search, making it easy to find what you’re looking for across users, issues, code and other project resources. #CodeCatalyst

​​🆕 Step Functions Distributed Map: https://aws.amazon.com/blogs/aws/step-functions-distributed-map-a-serverless-solution-for-large-scale-parallel-data-processing/ Step Function’s map state executes the same processing steps for multiple entries in a dataset. The existing map state is limited to 40 parallel iterations at a time. Glue vs EMR vs S3 Batch Operations ◆ Data scientists and data engineers use Glue and EMR to process large amounts of data. ◆ On the other hand, application developers will use Step Functions to add serverless data processing into their applications. Step Functions is able to scale from zero quickly, which makes it a good fit for interactive workloads where customers may be waiting for the results. ◆ System administrators and IT operation teams are likely to use S3 Batch Operations for single-step IT automation operations such as copying, tagging, or changing permissions on billions of S3 objects. #Step_Functions #serverless

🆕 Amazon EventBridge Pipes: https://aws.amazon.com/blogs/aws/new-create-point-to-point-integrations-between-event-producers-and-consumers-with-amazon-eventbridge-pipes/ EventBridge Pipes supports the following services as event sources: ✺ DynamoDB ✺ Kinesis ✺ Kafka/MSK ✺ SQS ✺ MQ #EventBridge_Pipes

🆕 AWS Application Composer 🔥

AWS re:Invent 2022 обзор анонсов часть 2 https://www.youtube.com/watch?v=cbxNxHIkd8M Присоединяйтесь к нам прямо сейчас! #reinvent

🆕 New features of Amazon SageMaker: ✺ AutoML step in SageMaker Model Building Pipelines ✺ Collaboration with shared spaces ✺ Data Wrangler data preparation widget ✺ Inference shadow tests ✺ Notebook-based Workflows ✺ SageMaker Model Cards ✺ SageMaker Model Dashboard ✺ SageMaker Role Manager ✺ SageMaker geospatial capabilities ✺ Studio Git extension #SageMaker #reinvent2022

🆕 New features of Amazon SageMaker: ✺ AutoML step in SageMaker Model Building Pipelines ✺ Collaboration with shared spaces ✺ Data Wrangler data preparation widget ✺ Inference shadow tests ✺ Notebook-based Workflows ✺ SageMaker Model Cards ✺ SageMaker Model Dashboard ✺ SageMaker Role Manager ✺ SageMaker geospatial capabilities ✺ Studio Git extension #SageMaker #reinvent2022

​​AWS re:Invent 2022 обзор анонсов часть 1: https://www.youtube.com/watch?v=dZyDPAZZ_CY 4:25 Новые Local Zones 8:20 OpenSearch Serverless 11:30 SimSpace Weave 21:57 DataZone 26:52 Security Lake 30:01 Clean Rooms 36:25 Nitro v5 44:17 EC2 C7gn 50:12 EC2 HPC6id 54:43 Lambda SnapStart 58:00 CloudWatch Internet Monitor 1:02:20 Verified Access 1:04:05 ECS Service Connect 1:06:05 Amazon Omics #reinvent