Aztk First let’s talk a bit about the Azure Distributed Data Engineering Toolkit. It’s a python CLI application for provisioning on-demand Spark on Docker clusters in Azure. This is an Open Source CLI that you can find it here. First install aztk on your local machinepip install aztk==0.8.1or directly from the repo follow these steps Initialize the […]
Why is Python the Best-Suited Programming Language for Machine Learning?
Machine Learning is the hottest trend in modern times. According to Forbes, Machine learning patents grew at a 34% rate between 2013 and 2017 and this is only set to increase in the future. And Python is the primary programming language used for much of the research and development in Machine Learning.
PySpark Pandas All code can be downloaded below and you can run it complete for free in Google Colab. from pyspark.sql import functions print(dir(functions)) AutoBatchedSerializer Column DataFrame DataType PandasUDFType PickleSerializer PythonEvalType SparkContext StringType ascii asin atan atan2 basse64 bitwiseNOT blacklist UserDefinedFunction abs acos add_onths approxCountDistinct apprrox_count_distinct array array_containsss asc broadcast bround cbrt ceil coalesce col […]
So if you know Pandas why should you learn Apache Spark? Pandas features: Tabular data ( and here more features than Spark ) Pandas can handle to million rows Limit to a single machine Pandas is not a distributed system. Dask vs Spark Apache Spark Dask Language Scala, Java, Python, R, SQL Python Scale 1-1000 […]
Easy continuous integration with Docker and Azure Function with Python. The value the return need to copied here in Docker Hub below Webhooks. Now when i new version is pushed to the Docker Hub Azure will update the code of the Azure Function. Link to the Github Repository https://github.com/dajor/barcodedocker
Sometimes it is still necessary to read a barcode from a document. In our example we show how this is possible in a serverless application. The Azure function trigger on a Azure Blog Storage and open the image and reads the bardcode and upload the document into SugarCRM. Because we use here a library zbar […]