This is the fifth post in a series covering Yelp’s real-time streaming data infrastructure. Our series explores in-depth how we stream MySQL updates in real-time with an exactly-once guarantee, how we automatically track & migrate schemas, how we process and transform streams, and finally how we connect all of this into datastores like Redshift and Salesforce. Read the posts in the series: Billions of Messages a Day – Yelp’s Real-time Data Pipeline Streaming MySQL tables in real-time to Kafka More Than Just a Schema Store PaaStorm: A Streaming Processor Data Pipeline: Salesforce Connector Yelp uses Salesforce, a customer relationship management…
via Planet MySQL
Data Pipeline: Salesforce Connector
How to Stream Tonight’s First Presidential Debate Online, No Cable Required
Tonight, presidential candidates Donald Trump and Hillary Clinton will meet for their first debate. Here’s how to tune in for free online, even if you don’t have cable.
The debate begins at 9PM ET/6PM PT.Host of NBC’s Nightly News Lester Holt will be moderating the debate. Tonight, all the questions will come from the moderator, but Facebook will be collecting questions throughout tonight’s debate for the next presidential debate on October 9th.
Here are some of the easiest ways to watch online:
- Watch on YouTube via streaming partners NBC News, Bloomberg Politics, or the Washington Post (embedded above).
- Watch Bloomberg TV’s coverage via Twitter.
- Watch ABC News’s coverage via Facebook.
If you do have a cable subscription, you can also watch on your phone, tablet, or set-top box with these options:
- Watch with CNN Go on iPhone, iPad, Android, Kindle Fire, Windows 10, Apple TV, or Roku.
- Watch with Fox News on iPhone, iPad, Android, Kindle Fire, Windows 10, Apple TV, or Roku.
Nearly every media site is covering the event, so you can pick which network you want to watch on. Note, while all of the following networks will have a live stream, some may require a cable subscription:
- ABC News
- BuzzFeed News
- CBS News
- CNN Go
- C-SPAN
- Fox News
- Hulu
- Huffington Post
- NBC News
- PBS
- Politico
- Telemundo
- Wall Street Journal
- Univision
- Yahoo
If you have your own Samsung Gear VR or Oculus Rift and want to watch the debates in the most novel way possible, AltspaceVR is also offering a virtual reality stream of the debate. So you really do have more choices than ever. Just keep in mind how your choice of media coverage can affect how you perceive the debates.
via Lifehacker
How to Stream Tonight’s First Presidential Debate Online, No Cable Required
Introducing BakaSQL, the MySQL web-based query executor
BakaSQL: a bit of history
When I joined this new company I was already aware there was a lot of work to do. There was no DBA Team to speak of; any MySQL related task was handled by the sysadmins, and the company was growing as fast as you can imagine, with 15-20 new employees arriving each month, most of them in the IT department. For sure, there was much fun ahead.
During my first week in the new job I immediately felt that something was not right. I was receiving too much DMLs to execute each day, spanning a wide set of servers, schemas an tables. This is not something I had seen before, so I started asking around what the reason behind it was. It turned out that there were multiple reasons behind it:
- there were known bugs in the applications that were never fixed
- application configuration items were stored in MySQL, but there was no admin panel to modify them
- accounting department had to apply corrections to the accounting records, which were also stored in MySQL, but again they had no tool to do this
- lastly, most developers did not have write privileges to production servers
Welcome, BakaSQL!
-
automatic generation of rollback scripts that will revert the changes applied by your DML when executed
-
confirmation that every query uses a proper index (avoid locking table scans!!)
-
dry run capability (check DML statements and compute rollback code without modifying the data)
-
logging of everything executed against the database, including reference ticket # if supplied
-
transaction consistency: your DML code is run in a single transaction so an all-or-nothing modification is enforced
- backticks (backquotes) are not allowed as these create troubles within bash, but there is a checkbox that you can use to wipe them out (check it when runnng in dry run mode)
- USE statement is not allowed, table names should be qualified if more than one schema is in use in the DML
- SHOW WARNINGS, COMMIT, ROLLBACK are not supported, we already run our own transaction anyways
- comments (double dash at start of line) should be removed from the code
- strings should be enclosed in single quotes; double quotes are not supported as string delimitator
- INSERT IGNORE is not supported so ask the requestor to make up his mind up and decide whether he really wants that row inserted or not
- auto_increment columns cannot be loaded with specific values, these are meant to be populated by MySQL
- WHERE conditions that have both an equality and an IN(), or multiple IN()s, are not supported (e.g.: where a = 1 and b in (2, 3) ) – these should be converted to all equalities
- statements that use NOT in the WHERE condition are not accepted as index is rarely used in that case, these need to be converted to avoid the NOT operator
- statements that use OR in the WHERE condition are not accepted for the same reason as above; these need to be converted to multiple statements instead
- subqueries are not supported, so if there is need to update some rows with the contents of some other table, CONCAT() can be used to generate updates by primary key that can be submitted to the tool
- setting values in UPDATE statements using functions is not supported
- BakaSQL only recognizes the single quote as a string delimiter, this is to make parsing simpler and faster; therefore, you need to properly escape single quotes in your strings if there are any
- BakaSQL does not like backticks (backquotes), these create problems within the bash script, however there is a checkbox that you can use to quickly remove all of them from the DML before execution. If the damn developer likes to use MySQL reserved words as column names, you can check the backtick removal checkbox, run a dry run to wipe them all, then re-add the backticks only around the reserved names used as column, that will work and allow you to proceed
- sometimes, when you receive DML through a ticket, there is some weird character in it. I have verified that Microsoft Word, and a few other editors, like to allow the user to specify UTF-8 characters that look exactly the same as their ASCII counterparts, but actually they are different. Specifiically, the double quote, the single quote and even the blank (space) character may have been replaced by some UTF-8 bizarre counterpart that BakaSQL will not digest. If you see weird behaviour when executing BakaSQL, check your DML code for those weird substitutes by copying the DML code into a 7 bit editor first
- if the last statement in the DML does not get executed (or if the only statement in a single statement DML does not get executed) it is likely that the semicolon that should delimit the query (or the queries) is not there; please check that out!
- the tool will not support changing (part of) a primary key with an update statement, as rollback code will be incorrect in this case; you will get an error if your DML tries to do that
- if, in an update statement, the WHERE condition contains one of the columns touched by the update, rollback may be incorrect; BakaSQL will try to fix simple cases for you, but remember to always check the rollback code…. if this situation is detected, you will see a warning right before the rollback code pertaining to the offending statement
Variables
set @myvar1 = (select val from rick.t1 where val=12121 and id = 1021);
set @myvar2 = (select val from rick.t1 where id = 1385);
set @myvar3 = (select 666);
insert into t1 (val) values (@myvar1);
insert into t1 (val) values (@last_insert_id), (@myvar2), (@myvar3);
Installation
- a Linux/UNIX server (don’t ask me about Windoze please)
- Apache httpd (or nginx, or your preferred web server that supports CGI specs)
- gcc compiler, to compile the BakaSQL utility
- HOSTFILE should point to a file that contains the list of the hostnames of your masters, one per line
- BASE should point to a folder where BakaSQL will save logs, rollback code and other information; it should be writable by the user that the webserver runs under
- MIN_REQ_CARDINALITY is the minimum cardinality, from 0 to 100, that you require for an index to be considered by BakaSQL good; sometimes, especially for small tables, you will get a false negative about the cardinality of an index, please see Ninja Mode below for a workaround
- BAKAUTILS is the path to the bakautils C program, see below
Ninja Mode
Where to get BakaSQL
Caveats
via Planet MySQL
Introducing BakaSQL, the MySQL web-based query executor
This Video Of A Guy Executing Fish With A Pistol Is Actually Good Because Lionfish Suck
I think every non-sociopath’s first instinct when seeing the title card of the video above—which lives up to its billing, as this is indeed a four-minute clip of a man equipped with a waterproof Glock who uses it to “fish” for lionfish—is one of dread. Oh no, you worry, accurately. Am I really about to watch someone brain scores of defenseless little fish with a goddamn handgun???
If you’re being honest, though, you can feel something else deep down there under all the guilt and disgust. Damn, you think, again accurately. It miiiight actually be kinda dope to pop a few off in some fish with a real-deal water gun.
Thankfully, the video makers provide some critical context that should allay your concerns about watching an extended fishy snuff film and allow you to watch the rest of the video with the same giddiness and slight pangs of jealousy as you would a Call of Duty highlight compilation. The context, here, is that lionfish are undeniable, unrepentant shitheads:
You see, the fisherman here is a hero, the fish themselves are villains, the body count he racks up proof of his awesome dedication to the environmentalist cause, and the lifeless corpses he flips into the camera’s lens a triumphant celebration that those waters now have one less evil lionfish to befoul our beautiful reefs.
Okay, maybe these kinds of slo-mo replays of a killing blow are a bit unnecessary…
…but let’s not forget who the bad guys are here. (Reminder: it’s the fish.)
Let this video do for marine biology what Indiana Jones did for archeology.
via Gizmodo
This Video Of A Guy Executing Fish With A Pistol Is Actually Good Because Lionfish Suck
OWASP OWTF – Offensive Web Testing Framework
OWASP Offensive Web Testing Framework is a project focused on penetration testing efficiency and alignment of security tests to security standards like: The OWASP Testing Guide (v3 and v4), the OWASP Top 10, PTES and NIST.
The purpose of this tool is to automate the manual and uncreative parts of pen testing. For example, Figuring out how to call “tool X” then parsing results of “tool X” manually to feed “tool Y” and so on is time consuming.
By reducing this burden we hope pen testers will have more time to:
- See the big picture and think out of the box,
- Find, verify and combine vulnerabilities efficiently,
- Have time to Investigate complex vulnerabilities like business logic, architectural flaws, virtual hosting sessions, etc.
- Perform more tactical/targeted fuzzing on seemingly risky areas
- Demonstrate true impact despite the short time-frames we are typically given to test.
This tool is however not a silver bullet and will only be as good as the person using it. Understanding and experience will be required to correctly interpret the tool output and decide what to investigate further in order to demonstrate the impact.
Features
- Web UI. Now configure and monitor OWTF via a responsive and powerful interface accessible via your browser.
- Exposes RESTful APIs to all core OWTF capabilties.
- Instead of implementing yet another spider (a hard job), OWTF will scrub the output of all tools/plugins run to gather as many URLs as possible.
- Scan by various aggression levels: OWTF supports scans which are based on the aggressiveness of the plugins/tools invoked.
- Extensible OWTF manages tools through ‘plugins’ making it trivial to add new tools.
- OWTF has been developed keeping Kali Linux in mind, but it also supports other pentesting distros such as Samurai-WTF, etc.
- Tool paths and configuration can be easily modified in the web interface.
- Fastest Python MiTM proxy yet!
- Crash reporting directly to Github issue tracker
- Comprehensive interactive report at end of each scan
- Easy plugin-based system; currently 100+ plugins!
- CLI and web interface
You can download OWASP OWTF here:
|
wget –N https://raw.githubusercontent.com/owtf/bootstrap-script/master/bootstrap.sh; bash bootstrap.sh |
Or read more here.
via Darknet – The Darkside
OWASP OWTF – Offensive Web Testing Framework
The Professional of Japan
Nissan Japan presents a brief compilation of their nation’s dedicated laborers, from craftspeople, to industrial workers, each performing their jobs with a sense of pride, regardless of how small or large of a task.
Owning a Ramen Restaurant
“I put my very best in every bowl I make.” Meet Kunimoto. He owns a ramen restaurant in Tokyo, Japan. Or, as YouTuber Life Where I’m From puts it, the restaurant owns him. He can’t find full-time employees, so he works from 8:00 am to 11:30pm six days a week.
Central Ohio home sales hit August record as inventory plummets
Home sales across Central Ohio reached a record high in August, even as the stock of houses for sale plummeted.
There were 3,116 homes and condos sold during the month, a 4.8 percent increase from August 2015, according to a report released Thursday by the Columbus Realtors. The month’s total was the highest ever for August and marked the year’s second-highest tally, trailing the 3,250 sold in June.
Columbus Realtors said 6,270 homes were listed for sale in August, down 21 percent from a year…
via Columbus Business News – Local Columbus News | Business First of Columbus
Central Ohio home sales hit August record as inventory plummets
DIY Tornado Machine
YouTuber NighthawkInLight made a machine that generates a small and safe vortex of air. The mini-tornado comes from a modified inline ventilation fan, while its visibility is enhanced by ultrasonic foggers and an LED lamp. It also serves as a humidifier.
GetResponse Review: The Best Budget E-mail Marketing Software for Small Businesses
E-mail marketing is, perhaps, the essential marketing strategy for small businesses. It’s personal, customizable and low cost. All you need to do is build a list of your customer’s e-mail addresses and then use a piece of e-mail marketing software to generate professional e-mails easily… Read More
The post GetResponse Review: The Best Budget E-mail Marketing Software for Small Businesses appeared first on Business Pundit.
via Business Pundit
GetResponse Review: The Best Budget E-mail Marketing Software for Small Businesses