Feed aggregator

How ProPublica Illinois Uses GNU Make to Load 1.4GB of Data Every Day

TuxMachines - Tue, 2018-07-10 15:15

I avoided using GNU Make in my data journalism work for a long time, partly because the documentation was so obtuse that I couldn’t see how Make, one of many extract-transform-load (ETL) processes, could help my day-to-day data reporting. But this year, to build The Money Game, I needed to load 1.4GB of Illinois political contribution and spending data every day, and the ETL process was taking hours, so I gave Make another chance.

Now the same process takes less than 30 minutes.

Here’s how it all works, but if you want to skip directly to the code, we’ve open-sourced it here.


GNU Make is well-suited to this task. Make’s model is built around describing the output files your ETL process should produce and the operations required to go from a set of original source files to a set of output files.

As with any ETL process, the goal is to preserve your original data, keep operations atomic and provide a simple and repeatable process that can be run over and over.

read more

Windstream's Nichols, Frane discuss why open source is important

TuxMachines - Tue, 2018-07-10 15:12

While the road to virtualization has included potholes and bad signage, open source can provide the right roadmap, according to Windstream executives.

Although some service providers are still on the fence when it comes to using open source, Windstream Enterprise's Arthur Nichols, vice president of network architecture and technology, and Mike Frane, vice president of product development and portal, are believers.

Windstream is using open source technologies or applications from OpenStack, ONOS, Kafka, Message Bus and RabbitMQ, to name just a few. It's also a member of the Open Network Automation Platform (ONAP) open source community.


  • Istio: The New Open Source Cloud Hotness

    Expect to hear a lot more about Istio, an emerging open source technology for orchestrating microservices networking. The buzz is already building, says Kip Compton, senior vice president of Cisco's cloud platform and solutions group.

  • Mapping Open Source Governance Models

    If you would like to contribute some data about the governance on an open source project which is not listed there or you have more details about one which is already listed please don't hesitate to contribute. Create a pull request or an open an issue and I'll get the information added.

    This is a nice small fun project. SUSE Hack Week gives me a bit of time to work on it. If you would like to join, please get in touch.

read more

15 open source applications for MacOS

LXer - Tue, 2018-07-10 15:09
I use open source tools whenever and wherever I can. I returned to college a while ago to earn a master's degree in educational leadership. Even though I switched from my favorite Linux laptop to a MacBook Pro (since I wasn't sure Linux would be accepted on campus), I decided I would keep using my favorite tools, even on MacOS, as much as I could.Fortunately, it was easy, and no professor ever questioned what software I used. Even so, I couldn't keep a secret.read more

Acquia CTO defines ‘decoupled’ Drupal

TuxMachines - Tue, 2018-07-10 15:09

Many open source enthusiasts (practitioners, paragons, partisans, preachers and protagonists) will have heard of Drupal.

For those that haven’t, Drupal is an open source content management framework, as well as an extended community of developers, maintainers and business supporters.

read more

Radeon ROCm 1.8.2 Compute Stack In Beta, Might Work Under Ubuntu 18.04 LTS

Phoronix - Tue, 2018-07-10 15:00
A new beta of the Radeon Open Compute "ROCm" stack was quietly made available for v1.8.2...

How to install OpenCV on Ubuntu 18.04

LinuxToday - Tue, 2018-07-10 15:00

OpenCV (Open Source Computer Vision Library) is an open source computer vision library and has bindings for C++, Python and Java .

How You Install Gno-Menu on Ubuntu Mate....?

Reddit - Tue, 2018-07-10 14:57

Just had ago at Cinnamenu(https://cinnamon-spices.linuxmint.com/applets/view/282) port version of GNO-Menu on cinnamon and i love it, simple, clear and big just what i'm looking for...when i click on the Menu favorite appeared shows row of apps on favriote section.

i Love this menu...https://cinnamon-spices.linuxmint.com/git/applets/Cinnamenu@json/screenshot.png ..this type of menu will replace stock menu, i'm going to try it Ubuntu replace Gnome-Shell or Fedora.


submitted by /u/apokalypsezz
[link] [comments]

DIY RV Offsite Backup and Media Server

Reddit - Tue, 2018-07-10 14:47

What better way to add a geeky touch to #vanlife than with a Linux server in your RV?


It just so happens that I recently got an RV—a 1996 Roadtrek 170 to be exact. Although this purchase has spawned a huge list of DIY projects, my very first Linux-based project focuses on the media center. At home, my media center is a Raspberry Pi running OSMC, and it works great for accessing my ripped DVDs and CDs from my NAS and playing them on my living-room TV. When I got the RV, I realized that one of the first things we'd want is a way to access all of that media from the road, even if we were in the middle of the woods.

In this article, I describe all the steps I took to build a media server just for the RV that maintains an up-to-date copy of my media and even syncs up automatically when it's parked in my driveway. It turns out that in the process of building a media server, I ended up with a pretty great off-site backup solution as well. Even if you don't own an RV, you could adapt these steps to add your own semi-offsite backup to your car.

submitted by /u/carlief007
[link] [comments]

Red Hat News

TuxMachines - Tue, 2018-07-10 14:33

read more

Unity 2018.2 Released With Lightweight Render Pipeline, Vulkan & HiDPI Support In Editor

Phoronix - Tue, 2018-07-10 14:30
Version 2018.2 of the Unity Game Engine is now available as the latest quarterly update to this widely-used, cross-platform engine. Unity 2018.2 is quite exciting and does include some Vulkan and Linux changes...

Security: NotSoSecure, Security Keys, Reproducible Builds and Hyped Malware

TuxMachines - Tue, 2018-07-10 14:29
  • Claranet Buys NotSoSecure

    Claranet, a managed service provider with services focused on western Europe and Brazil, has purchased NotSoSecure, a firm specializing in penetration testing and ethical hacker training.

    The purchase follows Claranet's 2017 acquisition of SEC-1, a security firm based in the United Kingdom. According to a Claranet statement announcing the purchase, the security acquisitions, together with the opening of a security operations center in Portugal, are part of the company's intention to increase their overall security services capabilities.

  • Firefox, Security Keys, U2F, and Google Advanced Protection

    Advanced Protection for Google Accounts uses a legacy web technology that is only partially supported in Firefox. Here is how you get started with physical security keys and extra protections for your Google Account in Firefox.


    Before you can enroll in the Google Advanced Protection program, you must have at least two security keys at the ready. You can use the same keys for multiple Google Accounts, and even reuse the same keys with different U2F-enabled web services.

    You should keep a record of which of your keys are registered with which websites. If you loose a key or want to decommission one, you’ll need this record to know all the accounts you’ll need to update.

    You can use any FIDO U2F security keys as long as they’re compatible with your devices. Google recommend you get one regular key with USB as your backup token, and one mobile-capable with wireless Bluetooth and NFC as the primary key you carry around with you. Specifically, Google recommends the YubiKey U2F (USB) and either the Feitan Multipass (Bluetooth/NFC/USB) or YubiKey Neo (NFC/USB). Bluetooth is more compatible with a wider range of devices, but the Bluetooth capabilities requires you to charge the key. NFC is less compatible with cheaper smartphones and other devices. However, neither NFC nor USB modes require you to charge the keys for them to operate.

  • Reproducible Builds: Weekly report #167
  • WellMess: This Go-based Malware Attacks Both Linux And Windows Machines [Ed: If the user actually needs to install it, then the threat is the user, not the program]

read more

True story

Reddit - Tue, 2018-07-10 14:08

Browsh: A Modern, Text-Based Web Browser

Phoronix - Tue, 2018-07-10 14:05
If the Lynx open-source text-based browser isn't satisfying your needs with viewing modern web sites via the terminal, Browsh is a new entrant into the text-based web-browser space that seeks to support modern web standards...

Linux top Command Tutorial for Beginners (8 Examples)

LXer - Tue, 2018-07-10 13:55
While working on the Linux command line, there may be times when you'd want to check process related details, like which process is consuming CPU or memory the most? Well, there exists a command - dubbed top - that lets you do this easily. In this tutorial, we will discuss this tool using some easy to understand examples.


Subscribe to LinuxInsight aggregator